KR20170029286A - Apparatus, method, and computer readable recording medium for aerial image process, navigation apparatus and server for path guide using aerial map - Google Patents

Abstract

An aerial image processing method is disclosed. The aerial image processing method comprises the steps of: receiving a winter aerial image and a non-winter aerial image; generating a mask image by detecting a green region in the non-winter aerial image; and generating a synthesis aerial image by synthesizing the generated mask image and the winter aerial image.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a navigation apparatus and a server for performing route guidance using an aviation map, a computer readable recording medium on which a program for aviation image processing is recorded, AERIAL IMAGE PROCESS, NAVIGATION APPARATUS AND SERVER FOR PATH GUIDE USING AERIAL MAP}

The present invention relates to an aviation image processing apparatus, an aviation image processing method, a computer readable recording medium on which a program for aviation image processing is recorded, a navigation apparatus and a server for performing route guidance using an aviation image.

Currently, traffic congestion is increasing as the number of vehicles such as automobiles is continuously increasing, and the rate of increase of such vehicles is very fast compared with the speed of expansion of infrastructure such as roads, and the seriousness of problems such as traffic congestion is emerging .

In this situation, navigation devices are attracting attention as one of solutions to traffic congestion. The navigation device receives a navigation message transmitted by a GPS (Global Positioning System) satellite, judges the current position of the moving object, matches the current position of the moving object with the map data and displays it on the screen, Of the vehicle. In addition, the navigation device guides the user to travel the moving object along the travel route, thereby allowing the user to efficiently use the given road network.

The map displayed on the screen of the navigation device normally displays roads and features based on the 2D images through the map data digitized by the digital map, or models the feature objects in 3D so as to have a more realistic feel.

In recent years, there has been provided a method for accurately grasping actual road conditions and surrounding conditions by performing route guidance using aerial photographs actually taken on an airplane. Especially, in the case of aviation images, as the accuracy increases, the role of map is being extinguished.

However, it is not easy to acquire aerial photographs taken in a weather condition with good photographing conditions. Especially in recent years, the number of shooting days with high clear indexes is gradually decreasing due to the influence of yellow dust or fine dust, so it becomes more difficult to obtain good quality aerial photographs.

Therefore, conventionally, aerial photographing was generally performed in the winter season. Then, in order to provide aerial photographs suitable for the present time when the winter season passes by and in the summer, the green areas are synthesized manually or aerial photographs are taken on the aerial images photographed in the winter season. However, in this case, it is possible to provide appropriate aerial photographs at the current time, but there is a problem that a lot of additional costs are incurred.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned needs, and it is an object of the present invention to provide a method of generating a synthetic aerial image by synthesizing a mask image and a winter aerial image by detecting a green area in non- An aviation image processing apparatus, an aviation image processing method, and a program for aviation image processing.

It is another object of the present invention to provide a navigation device and a server for performing route guidance based on an aerial map generated according to an aerial image processing method.

According to another aspect of the present invention, there is provided an aerial image processing method including receiving a winter aerial image and a non-winter aerial image, generating a mask image by detecting a green area in the non- And generating the synthetic aerial image by synthesizing the generated mask image and the winter aerial image.

The step of generating the mask image may include the steps of converting the non-winter aerial image into an HSV (Hue Saturation Value) image, generating an S (Saturation) channel image and a V (Value) channel image of the HSV image, Detecting a green area based on the pixel value, and generating a first mask image using the detected green area.

Also, the converting may include generating at least one pixel value of R (Red), G (Green), and B (Blue) in the non-winter aerial image to generate a non-winter aerial image in which the green area is highlighted And converting the non-panoramic aerial image highlighted with the green area into an HSV (Hue Saturation Value) image.

The method may further include generating a second mask image by performing a Gaussian filter process on the first mask image.

In addition, the step of generating the synthetic aerial image may include calculating a ratio for pixel value adjustment for each of the winter aerial image and the mask image, and calculating a ratio for adjusting the pixel value based on the calculated winter aerial image and the mask aerial image, And weighting each of the mask images and synthesizing them.

The method may further include generating an aerial map using a plurality of synthetic aerial images generated according to the aerial image processing method.

According to another aspect of the present invention, there is provided an aviation image processing apparatus for processing an aerial image using a winter aerial image and a non-winter aerial image according to an embodiment of the present invention, A mask image generating unit for generating a mask image, and a synthetic aerial image generating unit for synthesizing the generated mask image and the winter aerial image to generate a synthetic aerial image.

The mask image generation unit may further include an image conversion unit for converting the non-winter aerial image into a HSV (Hue Saturation Value) image, wherein the mask image generation unit generates the mask image for each of the S (Saturation) channel image and the V A green area detecting unit for detecting a green area based on a predetermined pixel value and a first mask image generating unit for generating a first mask image using the detected green area.

Also, the image converting unit may generate at least one pixel value of R (Red), G (Green), and B (Blue) in the non-winter aerial image to generate a non-winter aerial image highlighted with the green area, A non-winter aerial image highlighted with a green area can be converted into a HSV (Hue Saturation Value) image.

The mask image generation unit may further include a second mask image generation unit that performs a Gaussian filter process on the first mask image to generate a second mask image.

Also, the synthetic aerial image generating unit may calculate a ratio for adjusting the pixel values of the winter aerial image and the mask image, and calculate a ratio for each of the winter aerial image and the mask image based on the calculated ratio, Weighting can be given.

The navigation system may further include an aerial map generation unit that generates an aerial map using a plurality of synthetic aerial images generated according to the aerial image processing method.

According to another aspect of the present invention, there is provided a server for storing an aviation map generated by using the aviation image processing method.

When route guidance is requested in the navigation device connected to the server, the server generates route guidance information based on the stored aerial map, and transmits the generated route guidance information to the navigation device.

According to another aspect of the present invention, there is provided a navigation apparatus for performing route guidance based on an aerial map generated using the aerial image processing method.

According to another aspect of the present invention, there is provided a computer readable recording medium storing a program for executing the above-described method of processing an aviation image.

According to various embodiments of the present invention described above, the winter aerial image photographed in the last winter season can be automatically corrected to a non-winter aerial image suitable for non-winter time. Accordingly, it is possible to exclude a manual process of composing a green area or a re-photographing process of an aerial image on a winter aerial image, thereby avoiding a huge cost.

In addition, according to various embodiments of the present invention described above, it is possible to provide a guidance screen to a user by using an aerial map suitable for each period, and provide realistic information and guidance to the driver.

1 is a block diagram illustrating an aviation image processing apparatus according to an embodiment of the present invention.
2 is a block diagram illustrating an aviation image processing apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating an aerial image processing method of an aerial image processing apparatus according to an embodiment of the present invention.
4 is a flowchart illustrating a process of generating a mask image of an aerial image processing apparatus according to an embodiment of the present invention.
5 is a flowchart illustrating a process of generating a synthetic aerial image of an aerial image processing apparatus according to an embodiment of the present invention.
6A and 6B are views showing a non-winter aerial image and a winter aerial image according to an embodiment of the present invention.
7 is a diagram illustrating a second mask image according to an embodiment of the present invention.
8 is a view showing a synthetic aerial image according to an embodiment of the present invention.
9 is a block diagram illustrating a navigation device according to an embodiment of the present invention.
10 is a block diagram illustrating a server according to an embodiment of the present invention.
FIG. 11A is a view showing a route guidance screen using a winter aerial map according to an embodiment of the present invention, FIG. 11B is a view showing a route guidance screen using an aerial map generated according to an aerial image processing method according to an embodiment of the present invention, Fig.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, only intended for the purpose of enabling understanding of the concepts of the present invention, and are not to be construed as limited to such specifically recited embodiments and conditions do.

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein represent conceptual views of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an aviation image processing apparatus according to an embodiment of the present invention. 2 is a block diagram illustrating an aviation image processing apparatus according to an embodiment of the present invention.

1 and 2, an aerial image processing apparatus 10 includes an image conversion unit 11, a mask image generation unit 12, a synthetic aerial image generation unit 13, an air map generation unit 14, Some may be included. The mask image generating unit 12 may include all or part of the green area detecting unit 15, the first mask image generating unit 16, and the second mask image generating unit 17.

The aerial image processing apparatus 10 generates a mask image by detecting a green area in a non-winter aerial image, synthesizes the mask image and the winter aerial image to generate a synthetic aerial image, Can be used to generate an aerial map. Here, the aviation image processing apparatus 10 may be implemented as an image processor (image processor) provided in various electronic apparatuses for processing an input image.

The image processing of the aviation image processing apparatus 10 can be performed by receiving the winter aerial image and the non-winter aerial image.

The winter aerial image is an image of an indicator taken in the air in an airplane during the winter season. For example, the winter season may be in the period from December to February. In this winter season, there is not much greenery in mountains and forests, so that the area corresponding to greenery in the winter aerial image can be expressed in dark color close to black.

The non-winter aerial image is an image of an airborne terrestrial image taken on an airplane during non-winter time. For example, the non-winter time may be from November to November. In this non-winter period, there are many green areas such as mountains and forests, and areas corresponding to green areas in non-winter aerial images can be expressed in a color close to green.

Therefore, when the winter season passes the non-winter season, conventionally, the green area is manually combined with the aerial image photographed in the winter season, or the aerial image is taken again, There was a problem.

In order to solve this problem, the aviation image processing apparatus 10 according to an embodiment of the present invention can automatically perform image processing for synthesizing a green area in a winter aerial image. Specifically, the aerial image processing apparatus 10 can perform image processing for automatically correcting the winter aerial image photographed in the winter time period to a non-winter aerial image suitable for non-winter time.

Specifically, the image converting unit 11 may convert the non-winter aerial image into a HSV (Hue Saturation Value) image. For example, the winter aerial image and the non-winter aerial image input to the aviation image processing apparatus 10 may be RGB images defined in the RGB (Red Green Blue Color) color space. In this case, the image converting unit 11 may convert the RGB color space to another color space, such as HSV (Hue Saturation Value) space, to redefine the color value of the non-winter aerial image.

Also, the image converting unit 11 can emphasize the green area included in the non-winter aerial image so that the green area is more emphasized in the mask image to be generated based on the non-winter aerial image. Specifically, the image converting unit 11 may generate at least one pixel value of R (Red), G (Green), and B (Blue) in the non-winter aerial image to generate a non-winter aerial image highlighted with a green area . For example, the image converting unit 11 may increase pixel values of G (Green) among R (Red), G (Green), and B (Blue)

However, the above-described exemplary embodiments are only examples of the present invention, and the present invention is not limited thereto. For example, the input aerial image and the converted image may be implemented as images of different color spaces such as sRGB (super RGB), Cyan Magenta Yellow Black (CMYK), and Hue Saturation Brightness (HSB). Hereinafter, for convenience of explanation, the input aerial image is an RGB image, and the image converted by the image converting unit 11 is an HSV image.

The mask image generating unit 12 may generate a mask image by detecting a green area in the non-winter aerial image. The mask image generating unit 12 may include a green area detecting unit 15, a first mask image generating unit 16, and a second mask image generating unit 17.

The green zone detection unit 15 can detect a green zone based on a predetermined pixel value for each of the S (Saturation) channel image and the V (Value) channel image of the HSV image. Specifically, the green area detecting unit 15 detects a pixel having a first pixel value or more in the S (Saturation) channel image, detects a pixel below the second pixel value in the V (Value) channel image, AND) operation to detect a green area. For example, the green area detection unit 15 detects pixels of gray level 80 or more in the S (Saturation) channel image, detects pixels of gray level 100 or less in the V (Value) channel image, A green area can be detected.

The first mask image generator 16 may generate the first mask image using the detected green area. Here, the first mask image may be an image for separating the green area from the non-winter aerial image and synthesizing the green area into other images.

The second mask image generating unit 17 may generate a second mask image by performing a Gaussian filter process on the first mask image. Here, the second mask image may be an image obtained by applying a Gaussian filter to the first mask image to smooth the border.

Meanwhile, the synthetic aerial image generating unit 13 may synthesize the mask image and the winter aerial image generated by the mask image generating unit 12 to generate a synthetic aerial image. Here, the mask image may be the first mask image generated by the first mask image generating unit 16 or the second mask image generated by the second mask image generating unit 17.

In this case, the synthetic aerial image generating unit 13 may calculate a ratio for adjusting the pixel values of the winter aerial image and the mask image generated by the mask image generating unit 12, respectively. Then, the synthetic aerial image generating unit 13 may weight each of the winter aerial image and the second mask image based on the calculated ratio, and combine them.

For example, the synthetic aerial image generating unit 13 can generate a synthetic aerial image using Equation 1 below.

[Equation 1]

ratio = (c) / 128

(d) = (c) x ratio + (a) x (1 - ratio)

Here, ratio is a ratio, a is a pixel value of a winter aerial image, c is a pixel value of a mask image, and d is a pixel value of a synthetic aerial image.

On the other hand, the aerial map generating unit 14 can generate an aerial map using a plurality of synthetic aerial images generated according to the aerial image processing method. Specifically, the aerial map generation unit 14 may generate an aerial map by connecting each of the plurality of synthetic aerial images.

The aerial image processing method of the aerial image processing apparatus of FIGS. 1 and 2 will be described in more detail with reference to FIGS.

3 is a flowchart illustrating an aerial image processing method of an aerial image processing apparatus according to an embodiment of the present invention. Referring to FIG. 3, the aerial image processing apparatus 10 can receive the winter aerial image and the non-winter aerial image (S101). Here, the winter aerial image and the non-winter aerial image will be described in detail with reference to FIG.

FIG. 6A is a winter aerial image according to an embodiment of the present invention, and FIG. 6B is a diagram illustrating a non-winter aerial image according to an embodiment of the present invention. Referring to FIG. 6A, since there are not many green spots in mountains or forests in the winter season, mountains and forests can be darkly displayed in the winter aerial image. However, referring to FIG. 6B, since green peaks are present in mountains and forests during the non-winter season, mountains and forests can be brightly colored in non-winter aerial images.

On the other hand, if the winter aerial image and the non-winter aerial image are inputted, the aerial image processing apparatus can detect the green area in the non-winter aerial image to generate the mask image (S102). The operation of generating such a mask image will be described in detail with reference to FIG.

4 is a flowchart illustrating a process of generating a mask image of an aerial image processing apparatus according to an embodiment of the present invention. Referring to FIG. 4, the aerial image processing apparatus 10 may adjust at least one pixel value of R (Red), G (Green), and B (Blue) for emphasizing a green area in a non-winter aerial image S201).

Then, the aerial image processing apparatus 10 can convert the non-panoramic aerial image into the HSV image (S202). Specifically, the aviation image processing apparatus 10 converts the RGB color space into the HSV space, and converts the non-winter aerial image corresponding to the RGB image into the HSV image.

Then, the aviation image processing apparatus 10 can detect a green area based on a predetermined pixel value for each of the S (Saturation) channel image and the V (Value) channel image of the HSV image (S203). Specifically, the aviation image processing apparatus 10 detects a pixel of a first pixel value or more in a saturation channel image, detects a pixel of a second pixel value or less in a V (Value) channel image, (AND) operation to detect a green area.

Then, the aerial image processing apparatus 10 can generate the first mask image using the detected green area (S204).

Then, the aerial image processing apparatus 10 may generate a second mask image by performing a Gaussian filter process on the first mask image (S205). Here, the second mask image may be an image obtained by applying a Gaussian filter to the first mask image to smooth the border. The second mask image will be described in detail with reference to FIG.

7 is a diagram illustrating a second mask image according to an embodiment of the present invention. Referring to FIG. 7, the second mask image may be configured to include a green area (the green part in FIG. 7) and another area (the black part in FIG. 7) detected in the non-panoramic aerial image shown in FIG. 6B . Accordingly, the second mask image can be used to synthesize other images.

Meanwhile, following step S102 of FIG. 3, the aerial image processing apparatus 10 may synthesize the mask image and the winter aerial image to generate a synthetic aerial image (S103). The process of generating such a synthetic aerial image will be described in detail with reference to FIG.

5 is a flowchart illustrating a process of generating a synthetic aerial image of an aerial image processing apparatus according to an embodiment of the present invention. Referring to FIG. 5, the aerial image processing apparatus may calculate a ratio for adjusting a pixel value for each of the winter aerial image and the mask image (S301). Here, the ratio may be calculated for each pixel by dividing the pixel value of each of the plurality of pixels constituting the mask image by a specific value.

Then, the aerial image processing apparatus can combine the winter aerial image and the mask image by assigning weights to each of them based on the calculated ratio (S302). The synthetic aerial image generated according to such an operation will be described in detail with reference to FIG.

8 is a view showing a synthetic aerial image according to an embodiment of the present invention. That is, FIG. 8 can be generated by synthesizing the mask image of FIG. 7 and the winter aerial image of FIG. 6A. Referring to FIG. 8, the synthetic aerial image may include a green area, unlike the winter aerial image before synthesis shown in FIG. 6A.

Therefore, by using the image processing method of the present invention, it is possible to automatically correct the winter aerial image photographed in the last winter season to a non-winter aerial image suitable for the winter season. Accordingly, it is possible to exclude a manual process of composing a green area or a re-photographing process of an aerial image on a winter aerial image, thereby avoiding a huge cost.

9 is a block diagram illustrating a navigation device according to an embodiment of the present invention. 9, the navigation device 100 includes a storage unit 110, an input unit 120, an output unit 130, a control unit 170, a communication unit 180, a sensing unit 190, and a power unit 195 Including all or part of them.

Here, the navigation device 100 may be a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a smart glass, Project glass, navigation, black-box, and the like, and may be provided in a vehicle.

The driving-related guidance may include various guidance for assisting the driving of the driver, such as route guidance, lane departure guidance, forward vehicle departure guidance, traffic light change guidance, forward vehicle collision prevention guide, lane change guidance,

Here, the route guidance may include an augmented reality route guide for performing route guidance by combining various information such as the location and direction of a user to an image taken in front of a vehicle in operation, a 2D (2-Dimensional) or 3D (3-Dimensional (2-Dimensional) or 3D (3-Dimensional) route guidance for performing route guidance by combining various information such as a user's location, direction, and the like to map data of the user.

In addition, the route guidance may include an aerial map route guide for performing route guidance by combining various information such as the user's location, direction, and the like in the aerial map data. Here, the route guidance can be interpreted not only as a case in which the user rides on the vehicle but also includes a route guidance in the case where the user moves or jumps.

Further, the lane departure guidance may be to guide whether or not the vehicle being driven has departed from the lane.

In addition, the forward vehicle departure guidance may be to guide the departure of the vehicle located in front of the vehicle being stopped.

Further, the traffic light change guidance may be to guide the change of the traffic light located in front of the vehicle being stopped. For example, when the red signal lamp indicating the stop signal is turned on and the blue signal lamp indicating the start signal is changed, it may be guided.

The front vehicle collision avoidance guidance may be to guide the vehicle to avoid a collision with the preceding vehicle when the distance to the vehicle located in front of the stopped or running vehicle is within a certain distance.

In addition, the lane change guidance may be for guiding the change from the lane where the vehicle is located to another lane for guiding the route to the destination.

Also, the lane guidance may be to guide the lane where the vehicle is currently located.

Such driving-related images, such as the forward image of the vehicle, which enables the provision of various guides, can be photographed from a camera mounted on the vehicle. Here, the camera may be a camera that is integrally formed with the navigation device 100 mounted on the vehicle and photographs the front of the vehicle.

As another example, the camera may be a camera that is mounted on the vehicle separately from the navigation device 100 and photographs the front of the vehicle. In this case, the camera may be a separate black box mounted toward the front of the vehicle, and the navigation device 100 may receive the photographed image through wired / wireless communication with the separately mounted black box, When the storage medium to be stored is inserted into the navigation device 100, the navigation device 100 can receive a photographed image.

Hereinafter, the navigation device 100 according to an embodiment of the present invention will be described in more detail based on the above description.

The storage unit 110 stores various data and applications required for the operation of the navigation device 100. [ In particular, the storage unit 110 may store data necessary for the operation of the navigation device 100, for example, an OS, a route search application, map data, and the like. In addition, the storage unit 110 may store data generated by the operation of the navigation device 100, for example, the detected route data, the received image, and the like.

In addition, the storage unit 110 may store an aerial map for aerial map guidance. Here, the storage unit 110 may acquire and store the entire air map in advance. Alternatively, the storage unit 110 may receive and store an aerial map corresponding to the current position of the navigation device 100 from the server 200 in real time.

Such an aerial map may be a map generated based on the synthetic aerial image of Figs. 1 to 8 described above. Specifically, the aerial map can be generated by connecting a plurality of synthetic aerial images generated according to the procedures of FIGS. 1 to 8.

The storage unit 110 may be implemented as a random access memory (RAM), a flash memory, a ROM, an erasable programmable ROM (EPROM), an electronically erasable and programmable ROM (EEPROM), a register, a hard disk, Card, a Universal Subscriber Identity Module (USIM), or the like, as well as a detachable type storage device such as a USB memory.

The input unit 120 functions to convert a physical input from the outside of the navigation device 100 into a specific electric signal. Here, the input unit 120 may include all or some of the user input unit 121 and the microphone unit 123.

The user input unit 121 can receive user inputs such as touch, push operation, and the like. The user input unit 120 may be implemented using at least one of various types of buttons, a touch sensor for receiving a touch input, and a proximity sensor for receiving a motion to be accessed.

The microphone unit 123 can receive the user's voice and the sound generated from the inside and the outside of the vehicle.

The output unit 130 is a device for outputting the data of the navigation device 100. Here, the output unit 130 may include all or a part of the display unit 131 and the audio output unit 133.

The display unit 131 is a device that outputs data that the navigation device 100 can visually recognize. The display unit 131 may be implemented as a display unit provided on the front surface of the housing of the navigation device 100. The display unit 131 may be integrally formed with the navigation device 100 to output visual recognition data. The display unit 131 may be installed separately from the navigation device 100 such as a HUD (Head Up Display) You may.

The audio output unit 133 is a device that outputs data that the navigation device 100 can perceive audibly. The audio output unit 133 may be implemented as a speaker for expressing sound data to be notified to the user of the navigation device 100.

The communication unit 180 may be provided for the navigation device 100 to communicate with other devices. The communication unit 180 includes all or a part of the location data unit 181, the wireless Internet unit 183, the broadcast transmission / reception unit 185, the mobile communication unit 186, the short range communication unit 187, and the wired communication unit 189 can do.

The position data section 181 is a device for acquiring position data through a Global Navigation Satellite System (GNSS). GNSS means a navigation system capable of calculating the position of a receiving terminal using a radio signal received from a satellite. A specific example of GNSS is a GPS (Global Positioning System), a Galileo, a GLONASS (Global Orbiting Navigational Satellite System), a COMPASS, an Indian Regional Navigational Satellite System (IRNSS), a Quasi-Zenith Satellite System . The position data portion 181 of the navigation device 100 according to an embodiment of the present invention may receive the GNSS signal serviced in the area where the navigation device 100 is used and obtain position data.

The wireless Internet unit 183 is a device that connects to the wireless Internet to acquire or transmit data. The wireless Internet accessable through the wireless Internet unit 183 may be a wireless LAN (WLAN), a wireless broadband (Wibro), a world interoperability for microwave access (Wimax), or a high speed downlink packet access (HSDPA).

The broadcast transmitting and receiving unit 185 is a device for transmitting and receiving broadcast signals through various broadcasting systems. The broadcasting system that can transmit and receive through the broadcasting transmission and reception unit 185 is a digital broadcasting system such as DMBT (Digital Multimedia Broadcasting Terrestrial), DMBS (Digital Multimedia Broadcasting Satellite), MediaFLO (Media Forward Link Only), DVBH (Digital Video Broadcast Handheld) Integrated Services Digital Broadcast Terrestrial) and the like. The broadcast signal transmitted / received through the broadcast transmission / reception unit 185 may include traffic data, living data, and the like.

The mobile communication unit 186 can access and communicate with a mobile communication network according to various mobile communication standards such as 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE)

The short-range communication unit 187 is a device for short-range communication. As described above, the short-range communication unit 187 is a communication unit that transmits and receives data via Bluetooth, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra WidBand (UWB), a ZigBee, -Fi (Wireless-Fidelity) or the like.

The wired communication unit 189 is an interface device capable of wiredly connecting the navigation device 100 to another device. The wired communication unit 119 may be a USB module capable of communicating via a USB port.

The communication unit 180 includes at least one of the location data unit 181, the wireless Internet unit 183, the broadcast transmission / reception unit 185, the mobile communication unit 186, the short-range communication unit 187, and the wired communication unit 189 To communicate with other devices.

For example, when the navigation device 100 does not include a camera function, an image photographed by a vehicle camera such as a black box or the like can be received using at least one of the short-range communication unit 187 and the wired communication unit 189. [

As another example, in the case of communicating with a plurality of devices, either one may communicate with the short-range communication unit 187 and the other may communicate via the wired communication unit 119. [

The sensing unit 190 is a device capable of sensing the current state of the navigation device 100. The sensing unit 190 may include all or some of the motion sensing unit 191 and the optical sensing unit 193.

The motion sensing unit 191 can sense movement of the navigation device 100 in a three-dimensional space. The motion sensing unit 191 may include a three-axis geomagnetic sensor and a three-axis acceleration sensor. The motion data acquired through the motion sensing unit 191 can be combined with the position data acquired through the position data unit 181 to more accurately calculate the locus of the vehicle to which the electronic device 100 is attached.

The optical sensing unit 193 is a device for measuring the ambient illuminance of the electronic device 100. The brightness of the display unit 131 can be changed to correspond to the surrounding brightness by using the illuminance data acquired through the optical sensing unit 193. [

The power supply unit 195 is a device for supplying power necessary for operation of the electronic device 100 or operation of another device connected to the electronic device 100. [ The power supply unit 195 may be a battery built in the navigation device 100, or a device that receives power from an external power source such as a vehicle. The power supply unit 195 may be implemented as a wired communication module 119 according to the type of the power supply, or may be implemented as a wirelessly supplied device.

The control unit 170 controls the overall operation of the navigation device 100. More specifically, the control unit 170 controls all or a part of the storage unit 110, the input unit 120, the output unit 130, the control unit 170, the communication unit 180, the sensing unit 190, can do.

In particular, when the destination information is input through the input unit 120, the controller 170 can control the route guidance to the destination using the air map pre-stored in the storage unit 110.

Alternatively, when the destination information is inputted through the input unit 120, the controller 170 may transmit a route guidance request including at least one of the current location information and the destination information to the server 200. When the route guidance information for guiding the route is received from the server 200 according to the route guidance request, the controller 170 controls the route to the destination using the air route map according to the received route guidance information, So that the user can perform guidance. That is, the navigation device 100 can perform route guidance in real time in connection with the server 200 storing the aerial map. The server 200 will be described in detail with reference to FIG.

10 is a block diagram illustrating a server according to an embodiment of the present invention. 10, the server 200 may include all or some of the communication unit 210, the storage unit 220, and the control unit 230. Here, the server 200 may be implemented in various forms such as a web server and a route guidance server that provide a service (e.g., location guidance service, route guidance service, etc.) using an aerial map to the connected external device.

The communication unit 210 may provide a communication function between an external device connected to the server 200 and the server 200. [

Here, the communication unit 210 may be connected in a wireless or wired manner via a local area network (LAN) and an Internet network, a form connected through a USB (Universal Serial Bus) port, a mobile communication network Or a short-range wireless communication method such as NFC (Near Field Communication), Radio Frequency Identification (RFID), Wi-Fi, or the like.

The storage unit 220 may store an aerial map used for a location guidance service, a route guidance service, and the like. In particular, the storage unit 220 may map and store the aerial map to location information such as latitude, longitude, and the like. Such an aerial map may be a map generated by connecting the synthetic aerial images of Figs. 1 to 8 described above.

Herein, the storage unit 220 may be implemented as a random access memory (RAM), a flash memory, a ROM, an erasable programmable ROM (EPROM), an electronically erasable and programmable ROM (EEPROM), a register, a hard disk, Card, or the like, as well as a detachable type storage device such as a USB memory.

The storage unit 220 may be implemented in the server 200 or in the form of an external database (DB) connected to the server 200.

The control unit 230 controls the overall operation of the server 200. Specifically, the control unit 230 can control all or a part of the communication unit 210 and the storage unit 220.

In particular, when a route guidance request including at least one of current location information and destination information is received from the navigation device 100, the controller 230 displays the route guidance information using the received information and the air map stored in the storage unit 220 Can generate route guidance information for the user. Here, the route guidance information is information enabling the route guidance to the destination to be performed using the air navigation map, and may include an air map, a route guidance object, and the like corresponding to a predetermined distance range from the current position of the navigation device.

Then, the controller 230 can transmit the generated route guidance information to the navigation device 100. Accordingly, the navigation device 100 can perform route guidance to the destination through the aerial map using the received route guidance information. This will be described in detail with reference to FIG.

FIG. 11A is a view showing a route guidance screen using a winter aerial map, and FIG. 11B is a view illustrating a route guidance screen using an aerial map generated according to an aerial image processing method according to an embodiment of the present invention.

Referring to FIG. 11A, since there is not much greenery in mountains or forests in the winter season, mountains or forests can be darkly displayed on the route guidance screen 1101 using the winter aerial map.

However, referring to FIG. 11B, in the aerial map generated according to the above-described aerial image processing method, a green area synthesis operation is performed, and mountains or forests are brightly displayed in green on the route guidance screen 1102 using the aerial map .

According to the route guidance screen of the embodiment of the present invention, it is possible to provide the guidance screen to the user by using the aerial map suitable for each period, and to provide the driver with realistic information and guidance.

Meanwhile, the aviation image processing method according to various embodiments of the present invention may be implemented as a program and provided to a server or devices. Accordingly, each device can access the server or the device in which the program is stored, and download the program.

In addition, the aerial image processing method according to various embodiments of the present invention described above may be implemented as a program and stored in various non-transitory computer readable media. A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

10: aerial image processing apparatus 11: image conversion unit
12: mask image generating unit 13: synthetic aerial image generating unit
14: aerial map generating unit 15: green area detecting unit
16: First mask image generating unit 17: Second mask image generating unit
100: navigation device 110: storage unit
120: input unit 130: output unit
170: control unit 180: communication unit
190: sensing unit 195: power source unit
200: server 210:
220: storage unit 230:

Claims (14)

In an aerial image processing method,
Receiving a winter aerial image and a non-winter aerial image;
Detecting a green area in the non-winter aerial image to generate a mask image; And
And combining the generated mask image and the winter aerial image to generate a synthetic aerial image. The method according to claim 1,
Wherein the generating the mask image comprises:
Converting the non-panoramic aerial image into an HSV (Hue Saturation Value) image;
Detecting a green area based on a predetermined pixel value for each of an S (Saturation) channel image and a V (Value) channel image of the HSV image; And
And generating a mask image using the detected green area. 3. The method of claim 2,
Wherein the converting comprises:
Adjusting at least one pixel value of R (Red), G (Green), and B (Blue) in the non-winter aerial image to generate a non-winter aerial image highlighted with the green area; And
And converting the non-moving aerial image highlighted with the green area into a hue saturation value (HSV) image. The method according to claim 1,
Wherein the step of generating the synthetic aerial image comprises:
Calculating a ratio for pixel value adjustment for each of the winter aerial image and the mask image; And
And weighting and combining each of the winter aerial image and the mask image based on the calculated ratio. The method according to claim 1,
And generating an aerial map using a plurality of synthetic aerial images generated according to the aerial image processing method. 1. An aerial image processing apparatus for processing an aerial image using a winter aerial image and a non-winter aerial image,
A mask image generation unit for generating a mask image by detecting a green area in the non-winter aerial image; And
And a synthetic aerial image generation unit for synthesizing the generated mask image and the winter aerial image to generate a synthetic aerial image. The method according to claim 6,
And an image converter for converting the non-winter aerial image into an HSV (Hue Saturation Value) image,
Wherein the mask image generating unit comprises:
A green area detecting unit for detecting a green area based on a predetermined pixel value for each of an S (Saturation) channel image and a V (Value) channel image of the HSV image; And
And a mask image generator for generating a mask image using the detected green area. 8. The method of claim 7,
The image converter may include:
The method comprising: generating at least one pixel value of R (Red), G (Green), and B (Blue) in the non-winter aerial image to generate a non-winter aerial image highlighted with the green area, And converting the image into an HSV (Hue Saturation Value) image. The method according to claim 6,
Wherein the synthetic aerial image generating unit comprises:
The aerial image and the mask image are calculated and a weight is assigned to each of the winter aerial image and the mask image based on the calculated ratio to synthesize the aerial image and the mask image, An aerial image processing device. The method according to claim 6,
Further comprising: an aerial map generation unit configured to generate an aerial map using a plurality of synthetic aerial images generated according to the aerial image processing method. A server for storing an aerial map generated by using the aerial image processing method according to any one of claims 1 to 5. 12. The method of claim 11,
When a route guidance is requested in the navigation device connected to the server,
Wherein the server generates route guidance information based on the stored aerial map, and transmits the generated route guidance information to the navigation device. A navigation device for performing route guidance based on an aerial map generated by using the aerial image processing method according to any one of claims 1 to 5. A computer-readable recording medium storing a program for executing the aerial image processing method according to any one of claims 1 to 5.

Images