KR20160048351A - Navigation device, black-box and control method thereof - Google Patents

Abstract

Disclosed is a control method of a navigation device. The control method of the navigation device comprises: a step of acquiring a stop image from a video captured in real time by an image capturing unit when a specific event occurs while driving a vehicle; and a step of tagging the acquired stop image with driving state information of the vehicle to store the stop image tagged with the driving state information.

Description

NAVIGATION DEVICE, BLACK BOX AND CONTROL METHOD THEREOF BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a navigation device, a black box and a control method thereof, and more particularly to a navigation device, a black box and a control method thereof.

Most important when driving a vehicle is safety driving and prevention of traffic accidents. To this end, various auxiliary devices that perform posture control of the vehicle, control functions of the vehicle configuration devices, and safety devices such as seat belts and airbags are mounted on the vehicle have.

In recent years, electronic devices such as a navigation system and a black box have been installed in a vehicle to store data of a traveling image of a vehicle and data transmitted from various sensors, . Mobile phones such as smart phones and tablets can also be equipped with a black box or a navigation application.

However, the conventional vehicle electronic device has been provided only in a form in which the position information of the vehicle is recorded and stored in the traveling-related moving picture of the vehicle according to the real-time photographing, and the moving picture can be viewed when necessary. Therefore, the conventional vehicle electronic apparatus can not store the long-term moving image due to the storage capacity limitation problem of the storage medium.

In addition, conventional vehicle electronic devices have been provided with a type of event recording (for example, impact event recording, parking event recording, etc.) in a locally limited manner. Therefore, for example, when the user wants to check the video at the time of violating the traffic regulations, the user can search for the video at that point in time and check the video at the point of violation by playing back the detected video.

That is, according to the conventional vehicle electronic apparatus, the user has to invest a lot of time in order to confirm images according to various events.

In addition, in the case of violation of the traffic regulation, since a penalty fee is charged after a long period from the time of violation, it is highly likely that the stored moving picture is not stored according to the conventional vehicle electronic device, In most cases, you have to pay a penalty that is misleading or misleading.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned needs, and it is an object of the present invention to provide a method and apparatus for acquiring a still image from a moving image photographed by a photographing unit in real time, A navigation device for tagging and storing status information, a black box, and a control method thereof.

According to another aspect of the present invention, there is provided a method of controlling a navigation device, the method comprising: acquiring a still image from a moving image photographed by a photographing unit in real time when a specific event occurs during operation of the vehicle; And tagging the driving state information of the vehicle on the stored still image.

The specific event may include a first event indicating a violation of traffic regulations of the vehicle, a second event indicating that the vehicle is located in the intermittent interval, a third event indicating that the vehicle is located in the accident attention zone, And a fourth event indicating that the user setting value is satisfied.

The method may further include the step of determining whether the specific event is generated. When the specific event is the first event, the determining step may include: determining whether the specific event is the first event, It is possible to judge whether or not the traffic regulation is violated.

The storing step may store the driving state information including the position information of the vehicle and the speed information of the vehicle on the obtained still image.

In addition, when the specific event is the first event, the storing step may tag the driving state information further including the traffic regulation violation item information on the obtained still image and store the driving state information.

The method may further include automatically deleting the old moving image sequentially in accordance with a time point at which the moving image is stored, and automatically storing the deleted moving image until the user deletion command of the stored still image is input or until the storage period is exceeded As shown in FIG.

In addition, when the specific event is the first event, the storing step may classify and store the obtained still image according to the traffic regulation violation item.

The method may further include classifying the still images stored according to the event at a specific time according to a preset reference and displaying the classified still images on a screen.

The displaying step may include detecting a still image in which positional information within a predetermined distance from the stored position of the stored still images is tagged and arranging the detected still image in the order of distance from the position of the vehicle And displaying the information.

The displaying step may include a step of detecting a still image obtained recently based on a point in time of the stored still images, and a step of displaying the detected still images in a chronological order.

The displaying step may include a step of detecting a still image obtained in a path set according to a user's route guidance request among the stored still images, and a step of displaying the detected still images in a list.

The displaying may include detecting a still image obtained in accordance with a traffic regulation violation of the vehicle among the stored still images and displaying the detected still image in a list according to a traffic regulation violation item can do.

In the displaying step, a thumbnail image corresponding to the detected still image may be arranged and displayed in one area of the screen.

In addition, the displaying step may include generating an indicator for performing driving-related guidance, and displaying the generated indicator and thumbnail image through an augmented reality.

According to another aspect of the present invention, there is provided a navigation device including a storage unit, a photographing unit for photographing, And a control unit for controlling the storage unit to store driving state information of the vehicle on the obtained still image.

The event determination unit may determine whether the vehicle is in violation of a traffic regulation by using the vehicle operation pattern information at the location of the vehicle.

The navigation system according to claim 1, further comprising a position data unit for obtaining position data of the navigation device, wherein the control unit obtains travel state information including position information of the vehicle and speed information of the vehicle using the position data unit, And may control the storage unit to tag and store the obtained driving state information on the still image.

The control unit automatically deletes the old video sequence automatically based on the time point at which the moving image is stored and does not automatically delete the user until the deletion command of the stored still image is input or until the storage period is exceeded It is possible to control the storage unit to store the data.

The display unit may further include a display unit for displaying a still image stored according to the event at a specific time according to a preset reference and displaying the classified image on a screen.

The display unit may display a thumbnail image corresponding to the detected still image in a region of the screen.

In addition, the controller may generate an indicator for performing navigation-related guidance, and may control the display unit to display the generated indicator and thumbnail image through an augmented reality.

According to another aspect of the present invention, there is provided a method of controlling a navigation device, the method comprising: notifying occurrence of an event to a black box capable of communicating with the navigation device when a specific event occurs during operation of the vehicle; And receiving the tagged still image from the black box when the black box acquires the tagged still image according to the notification, and storing the received still image.

According to another aspect of the present invention, there is provided a method of controlling a black box, the method comprising: receiving a notification of occurrence of the specific event from a navigation device capable of communicating with the black box, A step of acquiring a still image from a moving image according to a real-time photographing of the photographing unit when the occurrence of the specific event is notified, a step of tagging and storing the driving state information of the vehicle on the obtained still image, To the navigation device.

According to another aspect of the present invention, there is provided a navigation device comprising: a storage unit; an event determination unit for determining whether a specific event has occurred during operation of the vehicle; And a communication unit for receiving the tagged still image from the black box when the black box acquires a still image tagged with vehicle running status information in accordance with the notification, And a control unit for controlling the storage unit to store the still image.

According to another aspect of the present invention, there is provided a black box, including a storage unit, a photographing unit for photographing, and a communication unit for communicating with the black box, A communication unit that receives notification of the occurrence of the specific event from a possible navigation device; a notification unit that acquires a still image from a moving image captured by the photographing unit in real time when the notification of the occurrence of the specific event is received, And a control unit for controlling the communication unit to transmit the stored still image to the navigation device.

According to various embodiments of the present invention, various event conditions that may occur in the vehicle, such as when the vehicle is in violation of traffic regulations, when the vehicle is located in the intermittent interval, when the vehicle is located in the accident attention zone, Event recording can be performed.

In addition, according to various embodiments of the present invention described above, an image according to the event described above can be stored as a still image to overcome the limitation of the storage capacity, and the still image can be stored for a long period of time.

In addition, according to various embodiments of the present invention, driving state information including vehicle speed information, vehicle violation item information, and the like is tagged and stored in a still image as well as vehicle position information, .

In addition, according to the various embodiments of the present invention described above, the still images according to the above-described events are classified and stored according to the event type, thereby enhancing the user's search convenience.

In addition, according to various embodiments of the present invention described above, it is possible to maximize the satisfaction of consumers by displaying a still image according to an event at a specific time on a screen so that the user can easily view it.

In addition, according to various embodiments of the present invention described above, it is possible to eliminate the misunderstanding of the user by storing still images at the time of transit violation even after a long period of time from the time of violation of the traffic regulations.

1 is a block diagram showing a navigation apparatus according to an embodiment of the present invention.
2 is a block diagram illustrating a black box according to an embodiment of the present invention.
3 is a diagram for explaining a system network according to an embodiment of the present invention.
4 is a view showing an embodiment in which the navigation device according to an embodiment of the present invention does not include a photographing part.
5 is a timing diagram illustrating a still image storage process of the system according to FIG.
6 is a view illustrating an embodiment in which a navigation device according to an embodiment of the present invention includes a photographing unit.
FIG. 7 is a flowchart illustrating a still image storing process of the navigation device according to FIG.
Fig. 8 is a flowchart showing the operation of the navigation apparatus after storing the still images of Figs. 4 to 7. Fig.
9 is a diagram showing an example of an augmented reality screen of a navigation device displayed during a stop.
10 is a diagram showing an example of an augmented reality screen of the navigation device displayed after the completion of the route guidance.
11 is a diagram showing an example of an augmented reality screen of a navigation device displayed while driving.
12 is a diagram illustrating an embodiment using an HUD (Head-Up Display) and an electronic device according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, only intended for the purpose of enabling understanding of the concepts of the present invention, and are not to be construed as limited to such specifically recited embodiments and conditions do.

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein represent conceptual views of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a navigation apparatus according to an embodiment of the present invention. 1, the navigation device 100 includes a storage unit 110, an input unit 120, an output unit 130, an event determination unit 140, a photographing unit 150, an augmented reality providing unit 160, A control unit 170, a communication unit 180, and a sensing unit 190. [

Here, the navigation device 100 may be a device capable of providing driving guidance to a driver, such as a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP) , Project glass, navigation, and the like.

Here, the running state of the vehicle may include various states in which the vehicle is being driven by the driver, such as a vehicle stopping state, a running state of the vehicle, a parking state of the vehicle, and the like.

The driving-related information includes various instructions for assisting the driver of the vehicle such as driving directions, lane departure guidance, forward vehicle departure guidance, signal guidance, signal change guidance, forward vehicle collision prevention guide, .

Here, the route guidance may include augmented reality route guidance for performing route guidance by combining various information such as a user's location, direction, and the like to an image of the front of the vehicle in operation, and a 2D (2-Dimensional) (2-Dimensional) or 3D (3-Dimensional) route guidance that combines various information such as a user's location, direction, Here, the route guidance can be interpreted not only as a case where the user rides on the vehicle but also as a concept including a route guidance when the user moves or jumps.

Further, the lane departure guidance may be to guide whether or not the vehicle being driven has departed from the lane.

In addition, the forward vehicle departure guidance may be to guide the departure of the vehicle located in front of the vehicle being stopped.

Further, the signal guidance may be for guiding signal states of a signal lamp located in front of a vehicle in operation, such as a stop signal, a straight signal, a left turn signal, a right turn signal, and the like. Here, the hues and shapes corresponding to the respective signals may differ from country to country. In Korea, the stop signal may be a red circle, the straight line signal may be a blue circle, the left turn signal may be a blue left arrow, and the right turn signal may be a blue right arrow.

Further, the signal change guidance may be to signal that the signal state of the traffic light located in front of the vehicle in operation has been changed. For example, if the stop signal is changed to the straight signal, it may be to guide the change.

The front vehicle collision avoidance guidance may be to guide the vehicle to avoid a collision with the preceding vehicle when the distance to the vehicle located in front of the stopped or running vehicle is within a certain distance.

In addition, the lane change guidance may be for guiding the change from the lane where the vehicle is located to another lane for guiding the route to the destination.

Also, the lane guidance may be to guide the lane where the vehicle is currently located.

The driving-related images enabling the provision of various kinds of guidance can be photographed in real time in the photographing unit 150 which is mounted toward the front of the vehicle. Here, the photographing unit 150 may be a camera integrally formed with the navigation device 100 mounted on the vehicle and photographing the front of the vehicle. In this case, the navigation device 100 of FIG. 1 may include a photographing unit 150 and may receive an image photographed by the photographing unit 150 formed as a single unit.

As another example, the photographing unit 150 may be a camera that is mounted on the vehicle separately from the navigation device 100 and photographs the front of the vehicle. In this case, the camera may be a black box 200 separate from the navigation device 100 that is mounted toward the front of the vehicle, and the navigation device 100 may transmit the captured image through the wireless communication with the black box 200 The navigation device 100 can receive a photographed image when a storage medium for receiving input or storing a photographed image of the black box 200 is inserted into the navigation device 100. [ In this case, the navigation device 100 of Fig. 1 may not include the photographing unit 150. [

Hereinafter, the navigation device 100 according to various embodiments of the present invention will be described in more detail based on the above description.

The storage unit 110 stores various data and applications required for the operation of the navigation device 100. [ In particular, the storage unit 110 may store data necessary for the operation of the navigation device 100, for example, an OS, a route search application, map data, and the like.

The storage unit 110 may store data generated by the operation of the navigation device 100, for example, a moving image captured by the photographing unit 150 in real time, a still image captured by capturing the moving image, And so on.

Herein, the storage unit 110 may be implemented as a random access memory (RAM), a flash memory, a ROM, an erasable programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a register, a hard disk, Card, a Universal Subscriber Identity Module (USIM), or the like, as well as a detachable type storage device such as a USB memory.

The input unit 120 functions to convert a physical input from the outside of the navigation device 100 into a specific electric signal. Here, the input unit 120 may include all or some of the user input unit 121 and the microphone unit 123.

The user input unit 121 can receive user inputs such as touch, push operation, and the like. Here, the user input unit 121 may be implemented using at least one of various types of buttons, a touch sensor for receiving a touch input, and a proximity sensor for receiving a motion to be accessed.

The microphone unit 123 can receive the user's voice and the sound generated from the inside and the outside of the vehicle.

The output unit 130 is a device for outputting the data of the navigation device 100. Here, the output unit 130 may include all or a part of the display unit 131 and the audio output unit 133.

The display unit 131 is a device that outputs data that the navigation device 100 can visually recognize. The display unit 131 may be implemented as a display unit provided on the front surface of the housing of the navigation device 100. Here, the display unit 131 may be integrally formed with the navigation device 100 to output visual recognition data, and may be installed separately from the navigation device 100 such as a HUD (Head Up Display) to output visual recognition data It is possible.

The audio output unit 133 is a device that outputs data that the navigation device 100 can perceive audibly. The audio output unit 133 may be implemented as a speaker for expressing sound data to be notified to the user of the navigation device 100.

The communication unit 180 may be provided for the navigation device 100 to communicate with other devices. The communication unit 180 includes a position data unit 181, a wireless Internet unit 183, a broadcast transmission / reception unit 185, a mobile communication unit 186, a short range communication unit 187, and a wired communication unit 189 . ≪ / RTI >

The position data section 181 is a device for acquiring position data through a Global Navigation Satellite System (GNSS). GNSS means a navigation system capable of calculating the position of a receiving terminal using a radio signal received from a satellite. A specific example of GNSS is a GPS (Global Positioning System), a Galileo, a GLONASS (Global Orbiting Navigational Satellite System), a COMPASS, an Indian Regional Navigational Satellite System (IRNSS), a Quasi-Zenith Satellite System . The position data portion 181 of the navigation device 100 according to an embodiment of the present invention may receive the GNSS signal serviced in the area where the navigation device 100 is used and obtain position data.

The wireless Internet unit 183 is a device that connects to the wireless Internet to acquire or transmit data. The wireless Internet accessable through the wireless Internet unit 183 may be a wireless LAN (WLAN), a wireless broadband (Wibro), a world interoperability for microwave access (Wimax), or a high speed downlink packet access (HSDPA).

The broadcast transmitting and receiving unit 185 is a device for transmitting and receiving broadcast signals through various broadcasting systems. The broadcasting system that can transmit and receive through the broadcasting transmission and reception unit 185 is a digital broadcasting system such as DMBT (Digital Multimedia Broadcasting Terrestrial), DMBS (Digital Multimedia Broadcasting Satellite), MediaFLO (Media Forward Link Only), DVBH (Digital Video Broadcast Handheld) Integrated Services Digital Broadcast Terrestrial) and the like. The broadcast signal transmitted / received through the broadcast transmission / reception unit 185 may include traffic data, living data, and the like.

The mobile communication unit 186 can access and communicate with a mobile communication network according to various mobile communication standards such as 3rd Generation Partnership Project (3GPP), 3rd Generation Partnership Project (3GPP2), Long Term Evolution (LTE)

The short-range communication unit 187 is a device for short-range communication. As described above, the short-range communication unit 187 is a communication unit that transmits and receives data via Bluetooth, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra WidBand (UWB), a ZigBee, -Fi (Wireless-Fidelity) or the like.

The wired communication unit 189 is an interface device capable of wiredly connecting the navigation device 100 to another device. The wired communication unit 119 may be a USB module capable of communicating via a USB port.

The communication unit 180 includes at least one of the location data unit 181, the wireless Internet unit 183, the broadcast transmission / reception unit 185, the mobile communication unit 186, the short-range communication unit 187, and the wired communication unit 189 To communicate with other devices.

For example, when the navigation device 100 does not include the photographing unit 150, the image captured by the vehicle camera such as the black box 200 may be used by using at least one of the local communication unit 187 and the wired communication unit 189 .

As another example, in the case of communicating with a plurality of devices, either one may communicate with the short-range communication unit 187 and the other may communicate via the wired communication unit 189. [

The sensing unit 190 is a device capable of sensing the current state of the navigation device 100. The sensing unit 190 may include all or some of the motion sensing unit 191 and the optical sensing unit 193.

The motion sensing unit 191 can sense movement of the navigation device 100 in a three-dimensional space. The motion sensing unit 191 may include a three-axis geomagnetic sensor and a three-axis acceleration sensor. The movement data obtained through the motion sensing unit 191 is combined with the position data acquired through the position data unit 181 to calculate a more accurate trajectory of the vehicle to which the navigation device 100 is attached.

The optical sensing unit 193 is a device for measuring the ambient illuminance of the navigation device 100. The brightness of the display unit 195 can be changed to correspond to the surrounding brightness by using the illuminance data acquired through the optical sensing unit 193. [

The power supply unit 195 is a device for supplying power necessary for the operation of the navigation device 100 or the operation of another device connected to the navigation device 100. The power supply unit 195 may be a battery built in the navigation device 100, or a device that receives power from an external power source such as a vehicle. In addition, the power supply unit 195 may be implemented as a wired communication module according to the type of power supply, or may be implemented as a wirelessly supplied device.

The event determination unit 140 may determine whether a specific event has occurred. Here, the specific event may include a first event indicating a violation of traffic regulations of the vehicle, a second event indicating that the vehicle is located in the intermittent interval, a third event indicating that the vehicle is located in the accident attention zone, And a fourth event indicating satisfaction.

In the case of the first event, the event determination unit 140 detects the traffic regulation intermittent position using the map data, and uses the traffic pattern information of the vehicle at the traffic regulation intermittent position, It is possible to determine whether an event has occurred or not. Here, the operation pattern information is information that enables the determination as to whether or not the vehicle is in violation of the traffic regulations. For example, the operation pattern information includes at least one of the speed of the vehicle, whether the vehicle is in a lane, whether the vehicle is moving for a predetermined time, It may be information corresponding to one.

For example, in the case of a speed violation, the event determination unit 140 detects the speed intermittent position using the map data, and detects the speed intermittent position using the map data, It is possible to determine whether an event has occurred or not. Alternatively, in the case of a deviation, the event determination unit 140 may detect the intermittent intermittent vehicle position using the map data, and determine whether the vehicle is traveling for a predetermined period of time at the detected intermittent intermittent vehicle position, 1 event can be determined.

However, the present invention is not limited to the above-described example. The event determination unit 140 operates similar to the above-described example, and can determine whether the vehicle is in violation of the traffic regulations, such as whether the vehicle is in violation of the overspeed restriction,

In the case of the second event, the event determination unit 140 detects the position of the vehicle using the position data unit 181 and detects the position of the intermittent interval using the map data, It is possible to determine whether or not the second event indicating the location is generated.

In the case of the third event, the event determination unit 140 detects the position of the vehicle using the position data unit 181 and detects the position of the accident attention zone using the map data, It is possible to determine whether or not a third event is generated.

In the case of the fourth event, the event determination unit 140 detects a user setting value such as a position, a viewpoint, and the like set by the user of the navigation device 100 and determines whether the vehicle satisfies the user setting value , It is possible to determine whether or not the fourth event has occurred.

The map data may be acquired from data previously stored in the storage unit 110 of the navigation device 100 or may be acquired from an external map database DB separate from the navigation device 100. [

On the other hand, the controller 170 controls the overall operation of the navigation device 100. The control unit 170 includes a storage unit 110, an input unit 120, an output unit 130, an event determination unit 140, a photographing unit 150, an augmented reality providing unit 160, a communication unit 180, All or a part of the sensing unit 190 can be controlled.

If it is determined that the specific event has occurred as a result of the determination by the event determination unit 140, the control unit 170 may acquire the still image from the moving image captured by the photographing unit 150 in real time. For example, when the determination unit 140 determines that a specific event has occurred, the control unit 170 captures the moving image according to the real-time shooting of the photographing unit 150 to acquire the still image have.

The control unit 170 may tag the running state information of the vehicle on the obtained still image. For example, the control unit 170 may tag the obtained still image with the driving state information including the vehicle position information and the vehicle speed information. As another example, when the generated event is a violation of the traffic regulations of the vehicle, the obtained still image includes not only the position information of the vehicle and the speed information of the vehicle but also the traffic regulation violation item information (for example, For example, speed violation, violation of parking distance, etc.).

The control unit 170 may control the storage unit 110 to store the still image tagged with the moving image and driving state information.

Here, if the specific event is the first event indicating the violation of the traffic regulation of the vehicle, the control unit 170 may control the storage unit 110 to classify and store the obtained still image according to the traffic regulation violation item. For example, the control unit 170 generates a folder corresponding to the traffic regulation violation item, stores the still image corresponding to the vehicle speed violation in the first folder, and stores the still image corresponding to the vehicle distance violation in the second folder The control unit 110 may control the storage unit 110 to store the data.

In order to solve the problem according to the storage space limit of the storage unit 110, the control unit 170 controls the storage unit 110 to automatically delete the video stored in the storage unit 110, 110).

However, if the user does not take up much storage space of the storage unit 110 and the user needs to check the stored still image at a later time, the control unit 170 displays a delete instruction for the stored still image through the input unit 120 The storage unit 110 may be controlled so as not to be automatically deleted until the storage period is exceeded or until the storage period is exceeded.

Meanwhile, the controller 170 may control the display unit 131 to display a still image stored on the screen according to the event at a specific point in time. Here, the specific point in time may be a point of time before the vehicle reaches the specific event allocation point, a point of time when the vehicle is stopped, a point of time when the guidance of the user is completed (for example, when the vehicle arrives at the destination) , A time point when the vehicle is parked, and the like.

In this case, the controller 170 may control the display unit 131 to display the still images stored in accordance with the event at a specific time according to predetermined criteria.

For example, the controller 170 detects a still image tagged with position information within a predetermined distance from the current position of the vehicle among the still images stored in the storage unit 110, and outputs the detected still image as a distance order So that the display unit 131 can be controlled to be displayed. Accordingly, the driver of the vehicle can confirm the stored still image and the driving state information at the time of occurrence of the event according to the event that occurred in the past in the vicinity of the current position of the vehicle.

In another example, the controller 170 may detect the recently obtained still image based on the current time point among the still images stored in the storage unit 110, display the detected still images in a time order, Can be controlled. Accordingly, the driver of the vehicle can confirm the stored still image and the driving state information at the time of the occurrence of the event according to the event that occurred recently based on the current point of view.

As another example, the controller 170 may detect a still image obtained from a path set according to a user's route guidance request among the still images stored in the storage unit 110, and display the detected still images 131 can be controlled. Accordingly, the driver of the vehicle can confirm the stored still image and the driving state information at the time of the occurrence of the event according to the event occurring during the navigation period of the navigation device 100.

As another example, the control unit 170 detects the still images acquired in accordance with the traffic regulation violation of the vehicle among the still images stored in the storage unit 110, and displays the detected still images in a list according to the traffic regulation violation item The display unit 131 can be controlled. Accordingly, the driver of the vehicle can confirm the driving status information of the stored still image and the traffic regulation violation time according to the violation of his / her traffic regulation.

Meanwhile, in the above-described still image display process, the controller 170 may control the display unit 131 to display a thumbnail image corresponding to the still image in one area of the screen. Accordingly, the display unit 131 can display a thumbnail image corresponding to a still image simultaneously with a screen such as a route guidance screen, a map screen, and the like.

If a user input for selecting a specific thumbnail image among a plurality of thumbnail images displayed in one area of the screen of the display unit 131 is received through the input unit 120, the controller 170 displays the still image corresponding to the selected thumbnail image May be displayed on the screen. In this case, the tagged running status information may be displayed together with one area of the displayed still image.

Meanwhile, the control unit 170 may control the navigation device 100 to perform navigation-related guidance based on the augmented reality. Herein, the augmented reality refers to the augmented reality, which includes additional information (for example, a graphical element representing a point of interest (POI), a graphical element representing a path to a destination, and the like) on a screen containing a real world It may be a method of visually overlapping the images. In this case, the controller 170 may generate an indicator for performing the navigation-related guidance in conjunction with the augmented reality providing unit 190, and may output the generated indicator through the output unit 140. For example, the augmented reality may be provided through the HUD using the windshield of the vehicle or an image overlay using a separate image output device, and the augmented reality providing unit 160 may provide the augmented reality image or the interface image overlaid on the glass Can be generated. Through this, augmented reality navigation or vehicle infotainment system can be implemented.

If the navigation device 100 does not include the photographing unit 150, the navigation device 100 can receive the still image through the wire / wireless communication with the black box 200, It is possible to operate as described above. The black box 200 will be described in detail with reference to FIG.

2 is a block diagram illustrating a black box according to an embodiment of the present invention. Here, the black box 200 may exchange data with the navigation device 100 to store data necessary for the accident process of the vehicle and the like. For example, when an accident occurs while driving the vehicle, the image data acquired and stored in the black box 200 may be analyzed to determine the degree of accident and the degree of the accident.

In addition, the black box 200 connected to the navigation device 100 can utilize various data stored in the navigation device 100. For example, it is possible to increase the utility of the vehicle black box 200 by matching the image acquired by the black box 200 with the map data stored in the navigation device 100.

The black box 200 can acquire the data of the vehicle during driving and during stopping. That is, it is possible not only to shoot a moving image of a vehicle, but also to shoot an image even when the vehicle is stationary. The image quality of the image obtained through the black box 200 may be constant or changed. For example, it is possible to store a core image while minimizing a required storage space by increasing the image quality before and after occurrence of an accident, and lowering the image quality in a normal case.

The black box 200 includes a communication unit 210, an AV input unit 220, a user input unit 230, a sensing unit 240, a storage unit 250, and a control unit 270 . ≪ / RTI >

The communication unit 210 is a device that can communicate with the communication unit 180 of the navigation device or another device. The communication unit 210 may include a short-range communication unit 211 and a wired communication unit 213. The local communication unit 211 can communicate with the local communication unit 187 of the navigation device 100 and the wired communication unit 213 can communicate with the wired communication unit 189 of the navigation device 100. [

The AV input unit 220 is a device capable of acquiring sounds and images. The AV input unit 220 may include a photographing unit 221 and a microphone unit 223.

The photographing unit 221 can acquire an image of the inside and the outside of the vehicle equipped with the black box 200.

The microphone unit 223 can acquire sound generated from the inside and the outside of the vehicle. The sound obtained through the microphone unit 223 can be used for controlling the operation of the black box 200. [ For example, when a stronger sound than usual is received through the microphone unit 223, the photographing unit 221 can acquire a higher resolution image.

The user input unit 230 is a device that allows the user to directly operate the operation of the black box 200. [ The user input unit 230 may be implemented as a push button (not shown) provided outside the black box 200. However, if the black box 200 is controlled by the control signal of the controller 170 of the navigation apparatus 100, the user input unit 230 may be excluded from the black box 200.

The sensing unit 240 is a device that can sense the current state of the black box 200. The sensing unit 240 may include a motion sensing unit 241 and performs an operation similar to the motion sensing unit 191 of the navigation device 100 except for the installed position. If the sensing unit 240 is provided in the black box 200, it may not receive data related to the motion of the three-dimensional space from the navigation device 100.

The storage unit 250 stores data necessary for the operation of the black box 200 and data generated by the operation. The data stored in the storage unit 250 may be an image acquired through the photographing unit 221. The storage unit 250 may be embedded in the black box 200 or may be a removable memory in the black box 200.

The control unit 270 can control the overall operation of the vehicle black box 200. [ The control unit 270 may control all or a part of the communication unit 210, the AV input unit 220, the user input unit 230, the sensing unit 240, and the storage unit 250.

Particularly, when a specific event occurs while the vehicle is in operation and is notified of the occurrence of a specific event from the navigation device 100, the control unit 270 can acquire a still image from the moving image according to the real-time shooting of the photographing unit 221 . For example, the control unit 270 can acquire a still image by capturing the moving image according to the real-time shooting of the photographing unit 221 at the time of notification of the occurrence of the event.

The control unit 270 may control the storage unit 250 to tag and store driving state information of the vehicle on the obtained still image. For example, the control unit 270 obtains driving state information including position information and speed information using a GPS module (not shown) of the black box 200, and outputs the obtained driving state information to the obtained still image The controller 250 may control the storage unit 250 to store the tagging information. For example, when the black box 200 does not have a GPS module for acquiring position information, speed information, etc., the black box 200 requests and receives navigation status information from the navigation device 100, The driving state information received from the terminal 100 can be tagged and stored in the obtained still image.

Meanwhile, the control unit 270 may control the communication unit 210 to transmit the still image tagged with the running state information to the navigation device 100 at a specific point in time. Here, the specific point in time may be a point of time before the vehicle reaches the specific event allocation point, a point of time when the vehicle is stopped, a point of time when the guidance of the user is completed (for example, when the vehicle arrives at the destination) , A time point when the vehicle is parked, and the like.

On the other hand, according to another example, the tagging process may not be performed in the black box 200. In this case, when the black box 200 transmits a still image to the navigation device 100, the navigation device 100 can tag and store the driving status information in the still image.

3 is a diagram for explaining a system network according to an embodiment of the present invention. Referring to FIG. 3, the navigation device 100 according to an embodiment of the present invention may be connected to various communication networks and other electronic devices 61 to 64.

Also, the navigation device 100 can calculate the current position and the current time zone by interlocking the GPS module according to the radio wave signal received from the satellite 20.

Each of the satellites 20 can transmit L-band frequencies having different frequency bands. The navigation device 100 can calculate the current position based on the time taken for the L band frequency transmitted from each satellite 20 to reach the navigation device 100. [

On the other hand, the navigation device 100 can wirelessly connect to the network 30 via the control unit 40 (ACR), the base station 50, and the RAS via the communication unit 180. [ When the navigation device 100 is connected to the network 30, it can indirectly connect with other electronic devices 61 and 62 connected to the network 30 to exchange data.

On the other hand, the navigation device 100 may be indirectly connected to the network 30 through another device 63 having a communication function. For example, when a module capable of connecting to the network 30 is not provided in the navigation device 100, it can communicate with another device 63 having a communication function via a short distance communication module or the like.

4 is a view showing an embodiment in which the navigation device according to an embodiment of the present invention does not include a photographing part. Referring to FIG. 4, a vehicle black box 200 provided separately from the navigation device 100 for a vehicle may constitute a system according to an embodiment of the present invention using a wire / wireless communication method.

The vehicle navigation system 100 may include a display unit 131 provided on the front surface of the navigation housing 191, a navigation operation key 121, and a navigation microphone 123.

The vehicle black box 200 may include a black box camera 222, a black box microphone 224, and an attaching portion 281. [

5 is a timing diagram showing the operation of the system according to Fig. Referring to FIG. 5, the navigation device 100 may notify the black box 200 of the occurrence of a specific event when a specific event occurs during operation of the vehicle (S101). Here, the specific event includes a first event indicating a violation of the traffic regulations of the vehicle, a second event indicating that the vehicle is located in the intermittent interval, a third event indicating that the vehicle is located in the accident attention zone, And a fourth event indicating that the value is satisfied.

When the black box 200 is notified of the occurrence of a specific event, the black box 200 can acquire a still image from the moving image according to the real-time shooting of the photographing unit 221 (S102).

Then, the black box 200 can tag and store the driving state information of the vehicle on the obtained still image (S103). Here, the running state information may include at least one of position information of the vehicle, speed information of the vehicle, and information on the violation of traffic regulations.

Then, the black box 200 can transmit the tagged still image to the navigation device (S104).

In this case, the navigation device 100 may store the received still image (S105).

4 to 5 illustrate that the vehicle black box 200 provided separately from the navigation device 100 for a vehicle is connected via a wire / wireless communication system. However, the navigation device 100 for a vehicle and the black box 200 for a vehicle / May not be connected through wireless communication method. In this case, when the storage medium storing the photographed image of the black box 200 is inserted into the navigation device 100, the navigation device 100 can receive the photographed image.

It is also possible that the vehicle black box 200 has the function of the navigation device 100 for the vehicle or the navigation device 100 for the vehicle is integrated with the photographing part. This will be described in detail with reference to FIG.

6 is a view illustrating an embodiment in which a navigation device according to an embodiment of the present invention includes a photographing unit. 6, when the navigation device 100 includes the photographing unit 150, the user can photograph the front of the vehicle by the photographing unit 150 of the navigation device 100, The navigation device 100 can be placed so that the portion can be recognized by the user. Accordingly, a system according to an embodiment of the present invention can be implemented.

7 is a flowchart showing the operation of the navigation device according to Fig. Referring to FIG. 7, the navigation device 100 may determine whether a specific event has occurred during operation of the vehicle (S201). Here, the specific event may include the above-mentioned examples.

As a result of the determination, the navigation device 100 may acquire a still image from a moving image captured by the photographing unit 150 in real time (S202).

Then, the navigation device 100 can tag and store the driving state information of the vehicle on the obtained still image (S203). Here, the traveling state information may include the above-described examples.

Fig. 8 is a flowchart showing the operation of the navigation apparatus after storing the still images of Figs. 4 to 7. Fig. Referring to FIG. 8, the navigation device 100 may classify a still image stored according to an event at a specific time according to a preset reference and display the classified still image on the screen (S301). Here, the specific point in time may be a point of time before the vehicle reaches the specific event allocation point, a point of time when the vehicle is stopped, a point of time when the guidance of the user is completed (for example, when the vehicle arrives at the destination) , A time point when the vehicle is parked, and the like. Further, in step S301 of displaying, the thumbnail images corresponding to the still images can be arranged and displayed in one area of the screen.

When the user selects a specific still image from among the plurality of still images, the navigation device 100 can display the selected still image and the tagged running status information together (S302).

On the other hand, the navigation device 100 can automatically delete old movies sequentially from the time when the moving pictures are stored (S303).

In addition, the navigation device 100 may store the stored still image without deleting it until the user deletion command is input or until the storage period is exceeded (S304).

9 is a diagram showing an example of an augmented reality screen of a navigation device displayed during a stop. 9, when the vehicle stops, the display unit 131 of the navigation device 100 displays thumbnail images (901, 902, 903, and 904) corresponding to a plurality of still images obtained recently based on the current time point, Can be displayed.

When a user input for selecting a specific thumbnail image 902 among a plurality of thumbnail images 901, 902, 903, and 904 displayed in one area of the screen of the display unit 131 is received through the input unit 120, the display unit 131 displays thumbnails The still image 905 corresponding to the image can be displayed in one area of the screen. In this case, tagged driving status information 906 such as speed information, time information, and the like of the vehicle may be displayed together with one area of the displayed still image.

10 is a diagram showing an example of an augmented reality screen of the navigation device displayed after the completion of the route guidance. Referring to FIG. 10, the display unit 131 of the navigation device 100 displays a thumbnail image corresponding to each of a plurality of still images obtained in a route set according to a route guidance request, (1001, 1002, 1003) can be displayed in one area of the screen. Further, the display unit 131 may display additional information such as running time information, average speed information, signal waiting information, etc. in the set route.

On the other hand, when a user input for selecting a specific thumbnail image among a plurality of thumbnail images 1001, 1002, and 1003 displayed in one area of the screen of the display unit 131 is received through the input unit 120, The still image corresponding to the thumbnail image can be displayed in one area of the screen. In this case, the tagged driving state information such as the speed information of the vehicle, the time information, and the like may be displayed in one area of the displayed still image.

11 is a diagram showing an example of an augmented reality screen of a navigation device displayed while driving. 11, the display unit 131 of the navigation device 100 detects a still image tagged with positional information within a predetermined distance from the current position of the vehicle among previously obtained still images during driving of the vehicle, Thumbnail images 1101 and 1102 corresponding to the detected still images can be displayed in one area of the screen. Also, the display unit 131 may display additional information such as an indicator for guiding the route together.

When a user input for selecting a specific thumbnail image among a plurality of thumbnail images 1101 and 1102 displayed in one area of the screen of the display unit 131 is received through the input unit 120, the display unit 131 displays a thumbnail image The still image corresponding to the still image can be displayed in one area of the screen. In this case, the tagged driving state information such as the speed information of the vehicle, the time information, and the like may be displayed in one area of the displayed still image.

12 is a diagram illustrating an embodiment using a head-up display (HUD) according to an embodiment of the present invention. Referring to FIG. 12, the HUD can display an augmented reality guidance screen on a head-up display through wired / wireless communication with other devices.

For example, the augmented reality may be provided through the HUD using the windshield of the vehicle or an image overlay using a separate image output device, and the augmented reality providing unit 160 may provide the augmented reality image or the interface image overlaid on the glass Can be generated. Through this, augmented reality navigation or vehicle infotainment system can be implemented.

Meanwhile, the control method according to various embodiments of the present invention described above can be implemented by a program and provided to a server or devices. Accordingly, each device can access the server or the device in which the program is stored, and download the program.

In addition, the control method according to various embodiments of the present invention described above can be implemented as a program and stored in various non-transitory computer readable media. A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: navigation device 110: storage unit
120: input unit 130: output unit
140: Event determination unit 150:
160: augmented reality providing unit 170:
180: communication unit 190: sensing unit
195: Power supply unit 200: Black box
210: communication unit 220: AV input unit
230: user input unit 240: sensing unit
250: storage unit 270:

Claims (25)

A control method for a navigation device,
Acquiring a still image from a moving image photographed by the photographing unit in real time when a specific event occurs during operation of the vehicle; And
And tagging and storing the driving state information of the vehicle on the obtained still image. The method according to claim 1,
The specific event may be,
A first event indicating a violation of traffic regulations of the vehicle, a second event indicating that the vehicle is located in an intermittent interval, a third event indicating that the vehicle is located in an accident attention zone, And a fourth event indicating a fourth event. 3. The method of claim 2,
Further comprising: determining whether the specific event has occurred,
Wherein if the specific event is the first event,
Wherein the controller determines whether the vehicle is in violation of a traffic regulation using the travel pattern information of the vehicle at the position of the vehicle. 3. The method of claim 2,
Wherein the storing step comprises:
Wherein the driving state information including the position information of the vehicle and the speed information of the vehicle is tagged and stored in the obtained still image. 5. The method of claim 4,
Wherein the storing step comprises:
If the specific event is the first event, the driving state information including the item of traffic regulation violation information is tagged and stored in the obtained still image. The method according to claim 1,
Automatically deleting old moving images sequentially from the time when the moving images are stored; And
Further comprising the step of: storing the stored still image without deleting the deleted still image until the delete instruction of the user is input or until the storage period is exceeded. 3. The method of claim 2,
Wherein the storing step comprises:
And if the specific event is the first event, classifying and storing the obtained still image according to the traffic regulation violation item. The method according to claim 1,
Further comprising the step of classifying the still images stored according to the event at a specific point in time according to a preset reference and displaying the classified still images on a screen. 9. The method of claim 8,
Wherein the displaying comprises:
Detecting a still image tagged with position information within a predetermined distance from the position of the vehicle among the stored still images; And
And displaying the detected still images in the order of distance from the position of the vehicle. 9. The method of claim 8,
Wherein the displaying comprises:
Detecting a recently obtained still image based on a point in time of the stored still images; And
And displaying the detected still images in a chronological order. 9. The method of claim 8,
Wherein the displaying comprises:
Detecting a still image obtained from a path set according to a user's route guidance request among the stored still images; And
And displaying and displaying the detected still images. 9. The method of claim 8,
Wherein the displaying comprises:
Detecting a still image obtained in accordance with a traffic rule violation of the vehicle among the stored still images; And
And displaying and displaying the detected still images in accordance with the traffic regulation violation item. The method according to any one of claims 9 to 12,
Wherein the displaying comprises:
And displaying a thumbnail image corresponding to the detected still image in a region of the screen. 14. The method of claim 13,
Wherein the displaying comprises:
Generating an indicator for performing the driving-related guidance; And
And displaying the generated indicator and thumbnail image through an augmented reality. A navigation device comprising:
A storage unit;
A photographing section for photographing; And
A control unit for acquiring a still image from a moving picture photographed by the photographing unit in real time and tagging the driving state information of the vehicle on the obtained still image and storing the tagged information in the storage unit when a specific event occurs while the vehicle is running; And a navigation device. 16. The method of claim 15,
Further comprising an event determiner for determining whether the specific event has occurred,
The event determination unit may determine,
Wherein the navigation device determines whether the vehicle is in violation of traffic regulations by using the travel pattern information of the vehicle at the position of the vehicle. 16. The method of claim 15,
And a position data portion for obtaining position data of the navigation device,
Wherein,
Wherein the control unit controls the storage unit to obtain driving state information including the position information of the vehicle and the speed information of the vehicle using the position data unit and to tag and store the obtained driving state information on the still image, . 16. The method of claim 15,
Wherein,
Automatically deletes the oldest moving images sequentially from the time when the moving images are stored,
Wherein the control unit controls the storage unit to store the stored still image without deleting the stored still image until the user deletion command is input or until the storage period is exceeded. 16. The method of claim 15,
Further comprising a display unit for displaying a still image stored in accordance with the event at a specific time according to a preset reference and displaying the classified still image on a screen. 20. The method of claim 19,
The display unit includes:
And displays thumbnail images corresponding to the detected still images in one area of the screen. 21. The method of claim 20,
Wherein,
Generates an indicator for performing navigation-related guidance, and controls the display unit to display the generated indicator and the thumbnail image through the augmented reality. A control method for a navigation device,
Notifying the occurrence of the event to a black box capable of communicating with the navigation device when a specific event occurs during operation of the vehicle;
Receiving the tagged still image from the black box when the black box acquires the tagged still image according to the traffic information; And
And storing the received still image. In a control method of a black box,
Receiving a notification of occurrence of the specific event from a navigation device capable of communicating with the black box when a specific event occurs during operation of the vehicle;
Acquiring a still image from a moving picture according to a real-time photographing of the photographing unit upon being notified of the occurrence of the specific event;
Tagging and storing the driving state information of the vehicle on the obtained still image; And
And transmitting the stored still image to the navigation device. A navigation device comprising:
A storage unit;
An event determination unit for determining whether a specific event occurs during operation of the vehicle;
When the specific event is generated, notifies the occurrence of the event to a black box capable of communicating with the navigation device, and when the black box acquires a still image in which the vehicle driving state information is tagged according to the notification, A communication unit for receiving from the black box; And
And a control unit for controlling the storage unit to store the received still image. In the black box,
A storage unit;
A photographing section for photographing;
A communication unit for notifying the occurrence of the specific event from a navigation device capable of communicating with the black box when a specific event occurs while the vehicle is running;
Wherein the control unit controls the storage unit to acquire a still image from a moving image according to a real time shooting of the photographing unit and to tag and store the driving state information of the vehicle on the obtained still image, And a control unit for controlling the communication unit to transmit an image to the navigation device.

Images