KR101448567B1 - Map Handling Method and System for 3D Object Extraction and Rendering using Image Maps - Google Patents

Abstract

The present invention relates to a method and apparatus for displaying a three-dimensional object such as a building, a factory building, a residential building, a stadium, etc. observed by a user directly on a video map using a two-dimensional image map provided through the Internet or a wireless communication network such as Google Earth and Microsoft BingMap The 3D object information including the height, the roof surface, and the position of the floor surface is extracted, and the extracted 3D object is expressed in three dimensions on the image map and the map processing for seamlessly rendering the exterior and interior of the 3D object ≪ / RTI >

Description

Field of the Invention < RTI ID = 0.0 > [0002] < / RTI > A map processing method and system for extracting and rendering three-

The present invention relates to a map processing method and system, and more particularly, to a map processing method and system for processing a map of a building, a factory building or the like viewed by a user directly on a video map using a two-dimensional image map provided through the Internet or a wireless communication network such as Google Earth and Microsoft BingMap , A residential building, a stadium, and the like, extracts three-dimensional object information including the height, roof surface, and bottom surface position of the three-dimensional object, and displays the extracted three-dimensional object on the image map in three dimensions, And more particularly, to a map processing method and system for seamlessly rendering exterior and interior.

In recent years, Internet portal companies such as Google and Microsoft have provided video maps created by using high resolution images taken from satellites or airplanes to the general users through the Internet or wireless communication network. As these video maps become widespread and many users are used in various fields, users are asking for more information on the video map, and video and map service providers like Google and Miscrsoft are providing more information I'm trying to. One of these efforts is to improve the 2D image map, which is provided in the form of a three-dimensional object such as a building, a factory building, a residential building, a stadium, etc. lying on the ground surface, They also provide video maps.

However, in order to provide the 3D image guidance service, it is possible to have 3D object information such as the height of the 3D objects, the roof surface in the image map, and the position of the bottom surface. Representative conventional techniques for extracting three-dimensional object information include a photogrammetric method using stereo images and a laser surveying method. However, this method requires a lot of manpower and budget, and therefore, It is practically impossible to extract the information about it. Because of this, 3D image maps currently being served are limited to urban areas in some major cities in North America and Europe.

A method of extracting three-dimensional building information using shadow analysis as an invention devised to solve a high-cost problem of a photogrammetric method or a laser surveying method using a conventional stereo image for extracting three-dimensional object information (Korean Patent No. 10-0647807 , Filed on November 13, 2006). According to the present invention, a three-dimensional object information is extracted from a single image by simulating a vertical line of a shadow and an object using an azimuth angle and an altitude angle of a light source and a camera, thereby projecting the three- Respectively. However, even in this case, there is a problem that meta information including the azimuth angle and altitude angle information of the light source at the time of shooting the image and the camera is necessarily required.

In order to solve the problems of the present invention, there is a method for extracting three-dimensional object information through shadow analysis in a single image without meta information (Korean Patent Application No. 10-2009-0125439, filed on December 16, 2009) In the case of 3D object information extracted from a single image without meta information, since the coordinate information of the extracted object is not an image coordinate but an image coordinate, in order to convert it into a map coordinate, additional meta information and a separate conversion process are required. There is a drawback that it is difficult to link directly with the map.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for searching a two-dimensional image map, such as Google Earth, Microsoft BingMap, There is provided a map processing method and system for extracting three-dimensional object information such as height, roof surface, and bottom surface position of a three-dimensional object such as an observed building, a factory building, a residential building,

It is still another object of the present invention to provide a map for rendering three-dimensional object information extracted on a video map in a three-dimensional manner on the image map and rendering the outside and inside of the three- And to provide a processing method and system.

According to an aspect of the present invention, there is provided a map processing method for extracting and displaying three-dimensional information on an object on a video map provided on a screen in a user terminal, Calculating a resolution representing a scale factor using map coordinates of the edges and corresponding edge screen coordinates; And an azimuth angle and an altitude angle of the sun at the time when the image map is photographed and an azimuth angle and an altitude angle of the camera using the resolutions and the coordinates of the roof surface, the bottom surface, and the shadow for the shadowed object on the image map And extracting and additionally displaying the three-dimensional solid surface of the object on the image map.

 The user terminal may receive the video map through a server on a wired / wireless Internet or a mobile communication network.

(MapX ₁ , MapY ₁ ), bottom left corner map coordinates (MapX ₂ , MapY ₂ ), top left corner screen coordinates (DispX ₁ , DispY ₁ ), and left top corner corner coordinates , it is possible to calculate the lower right corner of the screen coordinates (DispX _2, DispY ₂₎ [equation 1], and the resolution (GSD _y) of the x-resolution (GSD _x) and the y-direction of the direction used in to on the basis of, for .

(DispX, DispY) corresponding to arbitrary map coordinates (MapX, MapY) when the orientation of the map coordinate system when capturing the image map coincides with the orientation of the screen coordinate system of the image map provided to the user terminal The relationship can be determined by the following equation (2).

(DispX, DispY) corresponding to arbitrary map coordinates (MapX, MapY) when the orientation of the map coordinate system at the time of shooting the video map and the orientation of the screen coordinate system of the video map provided to the user terminal do not match, Can be determined by the following equations (3) and (4).

In order to calculate the azimuth angle Asun and the altitude angle Esun of the sun and the azimuth angle Acam and the altitude angle Ecam of the camera, one of the roof surface coordinates of the corresponding object (DispX ₃ , DispY ₃ ( ₅ ) using the bottom corner coordinates (DispX ₄ , DispY ₄ ) on the vertical line extending in the corresponding corner screen coordinates and the shadow corner screen coordinates (DispX ₅ , DispY ₅ ) corresponding to the corresponding edge screen coordinates. , And [Equation 6], where H1 is the height value of the corresponding object.

And receives the H1 from the user through the user terminal.

The H1 is a virtual height value or an actual height value of the corresponding entity, and when the H1 is re-input from the user, the height of the three-dimensional solid surface can be updated.

In order to calculate the azimuth angle (Asun) and altitude angle (Esun) of the sun and the azimuth angle (Acam) and altitude angle (Ecam) of the camera, a roof surface, a floor surface, A shadow may be assigned, or the user terminal may automatically specify the roof surface, floor, and shadow of the shadowed object.

Wherein the step of extracting and additionally displaying the three-dimensional solid surface of the object on the image map comprises the steps of: calculating an azimuth angle (Asun) and an altitude angle (Esun) of the sun relative to any one of the objects on the image map and an azimuth angle Extracting and additionally displaying the three-dimensional solid surface of the other entity according to the height (Acam) and the altitude angle (Ecam) of the other entity, and the roof surface and height (H2) of another entity specified by the user.

(DispX ₆ , DispY ₆ ), the corresponding bottom edge corner screen coordinates (DispX ₇ , DispY ₇ ), and the shadow corner screen coordinates (DispX ₈ , DispY ₈ ) 7] to display the three-dimensional solid surface of the other entity.

When the user designates the roof surface of the other object, a temporary bottom surface and a temporary shadow surface are created on the screen. The user draws the temporary floor surface to the bottom surface of the object using the coordinate input means, If the magnetic field is pulled to the shadow surface of the object, the height value of the other object and the three-dimensional solid surface can be extracted and displayed.

The corner map coordinates corresponding to the roof surface corner screen coordinates (DispX ₆ , DispY ₆ ), the corner map coordinates corresponding to the bottom floor corner screen coordinates (DispX ₇ , DispY ₇ ), and the height H2 of the object And can be used to provide information related to the object.

It is possible to extract the apparent color or brightness of the roof surface and the bottom surface of the object on the image map and to reflect the color or brightness on the roof surface and the bottom surface of the three dimensional solid surface. The color and brightness information of the roof surface and the bottom surface of the three-dimensional solid surface can be stored and managed in the storage means and utilized for providing information related to the object.

The user can render and display the three-dimensional solid surface according to the enlargement, reduction, or change of viewpoint by using the coordinate input means with respect to the image map.

The user determines whether or not the observation point is changed inside the three-dimensional solid surface in accordance with the enlargement, reduction, or change of the viewpoint by using the coordinate input means by the user, and performs rendering in real time when changing to the inside So that it can display its internal appearance.

If the observation time is changed to the inside, the content image for the inside of the object is provided, or the wall surface of the inside of the object is made transparent, .

According to another aspect of the present invention, there is provided a map processing system for extracting and displaying three-dimensional information on an object on a video map provided on a screen of a user terminal, the map coordinate system including a map coordinate of an edge of the video map displayed on the screen, First calculating means for calculating a resolution indicating a scale factor using the edge screen coordinates; The azimuth angle and altitude angle of the sun at the time the image map is photographed, azimuth angle and altitude angle of the camera using the resolution, and coordinates of the roof surface, bottom surface, and shadow of the shadowed object on the image map Second calculating means; And third calculating means for extracting and additionally displaying a three-dimensional solid surface for the individuals on the image map using the resolution, the azimuth angle and the altitude angle of the sun and the camera.

According to the map processing method and system of the present invention, it is possible to provide a map processing method and system, in which a user can obtain a height, a roof surface, and a floor surface of a three-dimensional object such as a building, a factory building, a residential building, Dimensional object information including the positional information, and display the extracted three-dimensional object on the image map in three dimensions.

In addition, according to the present invention, a three-dimensional object can be rendered on a two-dimensional image map provided through a network or the like so as to fit various observer's viewpoints, and the exterior and interior rendering of the three-dimensional object can be seamlessly performed.

1 is a diagram for explaining a map processing system according to an embodiment of the present invention.
2 is a flowchart illustrating a process of extracting and rendering a 3D object from a 2D image map provided through a network in the user terminal of FIG.
FIG. 3 is a view for explaining a process of extracting azimuth and altitude angles of the sun and the camera at the time of photographing the image map from the two-dimensional image map provided to the user terminal of FIG. 1;
FIG. 4 is a diagram for explaining a process of extracting a three-dimensional object from a two-dimensional image map provided to a user terminal after calculating altitude angles and azimuth angles of a sun and a camera as shown in FIG.
FIG. 5 is a diagram showing a result of three-dimensional rendering of a three-dimensional object extracted from a two-dimensional image map provided on a user terminal as shown in FIG. 4 on a video map.
FIG. 6 is an example of rendering the outside and inside of a three-dimensional object when the user adjusts the viewing point.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

1 is a diagram for explaining a map processing system 100 according to an embodiment of the present invention.

Referring to FIG. 1, a map processing system 100 according to an embodiment of the present invention includes a user terminal 110 (hereinafter referred to as " user ") 110 which communicates with each other via a wired Internet, a wireless Internet such as WiFi, WiBro, And a map providing server 120.

The user terminal 110 may include a variety of electronic devices or devices throughout the home or industrial community, such as a desktop PC, a notebook PC, an iPAD, an iPhone, and an IPTV, which can communicate with the map providing server 120 through the above- . Hereinafter, the map providing server 120 provides the two-dimensional image map to the user terminal 110 via the network, and the user terminal 110 provides the map processing service of the present invention in cooperation with the map providing server 120 However, the present invention is not limited thereto. In some cases, the user terminal 110 may store information necessary for a service such as map coordinates, which is similar to a video map provided by the map providing server 120, The user terminal 110 may provide the map processing service of the present invention by itself.

In order to provide a map processing service in the user terminal 110 as described below, a predetermined application for a predetermined map processing service may be installed in the user terminal 110, and an application installed for the map processing service and other users Hardware in the terminal 110 can operate in conjunction with each other.

FIG. 2 is a flowchart illustrating a process of extracting and rendering a three-dimensional object from a two-dimensional image map provided through a network in the user terminal 110 of FIG.

To described above, the user selects the region the desired three-dimensional object information to extract the user terminal 110, which is the from the map server 120 through the network 2-D image map and the edge map coordinates (MapX _i, MapY _the user terminal 110 can obtain the resolution GSD and the screen coordinate values DispX _i and DispY _i of the displayed video map and the map coordinates MapX _i and MapY extracting the conversion relationship between _i) and (S110), the user calculates the sun and the camera azimuth and elevation angle information of the time to take the image map, as the roof surface, specifies the bottom surface, the shadows of the specific object, and ( S120), applying the calculated resolution (GSD), conversion relation, azimuth and elevation angle information of the sun and the camera to other objects so as to calculate the height of the three-dimensional objects, the roof surface corner coordinates and the map coordinates, The 3D object information including the surface coordinates, the map coordinates, the shadow edge screen coordinates, the roof surface, and the vertical surface texture information can be extracted and displayed (S130 to S151). In addition, the user terminal 110 may render the three-dimensional object in accordance with various viewpoints of the observer according to the enlargement / reduction of the map, the selection of the up / down / right / (S160 to S190).

First, a user accesses a map providing server 120 through a network through a user terminal 110 to request a video map (information) (S100). Then, the user inputs a corresponding two-dimensional video map provided by the map providing server 120 you can take the edge provided map coordinates (MapX _i, MapY _i) to display the map image on the screen (S102). The user can operate a keyboard, a mouse, etc. of the user terminal 110 to select an area desired to extract three-dimensional object information through enlargement, reduction, up / down / right / and, the map server 120 may provide the corresponding 2-D image map and the edge map coordinates _(i MapX, MapY _i) user terminals 110 in accordance thereto. Certain means for interlocking with an application in the user terminal 110 (for example, the screen coordinate calculation means) is a Cartesian coordinate system (x, y) 4 of the corner screen coordinates (DispX _i, DispY _i) on each time the image map is provided display Can be calculated.

In this way, the three-dimensional object information extraction when displaying an image map for the area wishing to, by using the user terminal 110 is provided edge map coordinates (MapX _i, MapY _i), x for the displayed image map, (MapX, MapY) corresponding to the y-direction resolution (GSD _x , GSD _y ) and each screen coordinate (DispX, DispY) (S110). Predetermined means (for example, resolution and conversion relation calculating means) linked with the application in the user terminal 110 can display the resolution (GSD _x , GSD _y ) in the x and y directions and the conversion relationship Can be extracted.

For example, the user terminal 110 can calculate the resolutions (GSD _x , GSD _y ) in the x and y directions as shown in the following equation (1). Here, the resolutions in the x and y directions (GSD _x , GSD _y ) represent the scale ratios in the respective directions between the map coordinate system based on the actual distance in the real world and the screen coordinate system of the provided image map. (MapX ₁ , MapY ₁ ), upper left corner map coordinates (MapX ₂ , MapY ₂ ), upper left corner screen coordinates (DispX ₁ , DispY ₁ ), and lower right corner screen coordinates (DispX ₂ , DispY ₂ ).

[Equation 1]

GSD _x = (MapX ₂ - MapX ₁ ) / (DispX ₂ - DispX ₁ )

GSD _y = (MapY ₂ - MapY ₁ ) / (DispY ₂ - DispY ₁ )

In addition, the user terminal 110 calculates the screen coordinates of each position of the video map provided on the screen as shown in Equation (2) or (3) based on the resolutions (GSD _x , GSD _y ) It is possible to calculate the conversion relation indicating the corresponding map coordinates. DispX, DispY and map coordinates (MapX, MapY) are associated with each other during the viewpoint change (up / down / left / right viewpoint movement) of the video map provided on the screen, The degree to which the orientation of the map coordinate system of the robot is changed.

For example, the image map provided on the screen may change the orientation of the screen coordinate system while the viewpoint is changed. When the orientation of the map coordinate system of the map image provided on the screen coincides with the orientation of the screen coordinate system, x-axis, in the case of the y-axis direction consistent with the map coordinate x-axis and y-axis directions, respectively, as shown in equation (2), any geographic coordinates (MapX, MapY) resolution (GSD _x, GSD _y) and The transformation relation indicating map coordinates (MapX, MapY) corresponding to each screen coordinate (DispX, DispY) can be calculated by using the upper left corner map coordinates (MapX ₁ , MapY ₁ ) of the video map.

&Quot; (2) "

MapX = DispX * GSD _x + MapX ₁

MapY = DispY * GSD _y + MapY ₁

For example, when the orientation of the map coordinate system of the map image provided on the screen does not coincide with the orientation of the screen coordinate system, that is, when the viewpoint change (up / down / right / (MapX, MapY) corresponding to the screen coordinates (DispX, DispY) of each position with respect to the image map provided on the screen, as shown in Equation (4), in the azimuth of the arbitrary screen coordinate system when the azimuth is changed The relationship can be calculated. In the formula 3; a, b, c, d, e, f are screen coordinates, and as a function of the conversion relationship between geographic coordinates, as shown in [Equation 4], each of the four corner of the map coordinates (MapX _i, MapY _i (i = 1, 2, 3, 4) and corresponding four corner screen coordinates (DispX _i , DispY _i ) (i = 1, 2, 3, 4).

&Quot; (3) "

MapX = a * DispX + b * DispY + c

MapY = d * DispX + e * DispY + f

&Quot; (4) "

On the other hand, after calculating the conversion relations indicating the map coordinates (MapX, MapY) corresponding to the resolution (GSD _x , GSD _y ) in the x and y directions and the screen coordinates (DispX, DispY) (S120), the azimuth and elevation angle information of the sun and the camera at the time of capturing the corresponding image map is calculated according to the user designating the roof surface, bottom surface, and shadow of the specific object on the image map. The predetermined means (for example, the azimuth angle and altitude angle calculating means) linked with the application in the user terminal 110 receives the necessary input from the user using Equation (5) and Equation (6) The azimuth and elevation angle information of the sun and the camera at the time of shooting the map can be calculated.

In order to calculate the azimuth angle and altitude angle information of the sun and the camera at the time of shooting the corresponding image map provided on the screen, first, the user (E.g., a building, etc.) with a shadow on the image map and selects the roof surface of the object (for example, the roof surface of the building is viewed as a square surface), the floor surface A square face corresponding to the bottom of the building), and a shadow (eg, the shadow created by the building at the time the image map was taken). Optionally, the user terminal 110 may estimate and automatically select any entity (e.g., a building) with a shadow to determine the roof surface of the entity (e.g., a square surface where the roof of the building is visible) A square face corresponding to the bottom of the building), and a shadow (e.g., a shadow created by the building at the time the corresponding image map was taken).

3, the user terminal 110 may obtain the coordinates of any one of the corresponding roof surfaces, for example, (DispX ₃ , DispY ₃ ), floor corner coordinates on a vertical line extending from the corresponding corner screen coordinates For example, (DispX ₄ , DispY ₄ ) and corresponding shadow edge screen coordinates corresponding to the corresponding edge screen coordinates, for example, (DispX ₅ , DispY ₅ ) The camera azimuth angle Acam, the camera altitude angle Ecam, the azimuth angle of the sun and the altitude angle Esun of the sun can be calculated as shown in Equation 5 and Equation 6. H1 used in the altitude angle Ecam of the camera and the altitude angle Esun of the sun in the equations (5) and (6) is a height of an object (e.g., a building, etc.) If the actual height is known, the actual height value is input by the user, otherwise an arbitrary height value can be input and used by the user.

&Quot; (5) "

XLen1 = (DispX ₄ - DispX ₃ ) * GSD _x

YLen1 = (DispY ₄ - DispY ₃ ) * GSD _y

Acam = assign (YLen1 / XLen1)

Ecam = atan (H1 / sqrt (XLen1 * XLen1 + Ylen1 * Ylen1))

&Quot; (6) "

XLen2 = (DispX ₅ - DispX ₄ ) * GSD _x

_{YLen2 = (DispY 5 - DispY 4} ) * GSD y

Asun = assign (YLen2 / XLen2)

Esun = assign (H1 / sqrt (XLen2 * XLen2 + Ylen2 * Ylen2))

In this way, the roof surface (eg, the roof of the building), the floor surface (eg, the square surface corresponding to the floor of the building), and the shadow (Eg, the shadow created by the building at the time of shooting the map), the camera's azimuth (Acam), camera's altitude angle (Ecam), sun's azimuth (Asun), sun's altitude angle (Esun) It is possible to change the display state of the video map such as the viewpoint change, enlargement or reduction of the video map by using the above-mentioned parameters 330, 5, (For example, an object information calculating means) is a means for calculating a distance between a surface of the object (for example, a cube) additionally displayed on the roof surface of the object and a bottom surface extending therefrom and a shadow region extending from the bottom surface, this The object can be displayed in three-dimensional form. However, when an arbitrary height value is input as H1 as described above, the height values of the object and the three-dimensional objects extracted thereafter are not a true height value but have a virtual height value proportional to a used arbitrary height value do. When the actual height value is input as H1 at any time, the height of the three-dimensional objects displayed on the image map can represent a height based on the actual height, and an object that knows the actual height value of the three- At any time, the above-mentioned camera's azimuth (Acam), the camera altitude angle (Ecam), the sun's azimuth angle (Asun), and the sun altitude angle (Esun) can be calculated again to update the three-dimensional objects to the correct height.

In this way, the user terminal 110 applies the resolution GSD calculated in step S120, the conversion relation, the azimuth angle and altitude angle information of the sun and the camera to other entities, and the user terminal 110 calculates the height, Dimensional object information including the map coordinates, the bottom edge corner screen coordinates, the map coordinates, the shadow corner screen coordinates, the roof surface, and the vertical surface texture information, and further displays the three-dimensional solid surface (S130 to S151) . The predetermined means (for example, the object information calculating means) that interacts with the application in the user terminal 110 applies the above calculated resolution GSD, the conversion relation, the azimuth and elevation angle information of the sun and the camera to other objects, Similarly, if the user specifies only the roof surface and height of another object, or only the roof surface and the floor surface of another object or only the roof surface and the shadow surface are specified, the height, roof surface corner coordinate Dimensional object information including a map coordinate, a bottom edge corner screen coordinate and a map coordinate, a shadow corner screen coordinate, a roof surface, and a vertical surface (wall surface) texture information can be extracted and a three-dimensional solid surface can additionally be displayed.

&Quot; (7) "

DispX ₇ = DispX ₆ - (H2 / GSD _x ) * sin (Acam) / tan (Ecam)

DispY ₇ = DispY ₆ - (H 2 / GSD _y ) * cos (Acam) / tan (Ecam)

DispX ₈ = DispX ₇ - (H2 / GSD _x ) * sin (Asun) / tan (Esun)

DispY ₈ = DispY ₇ - (H 2 / GSD _y ) * cos (Asun) / tan (Esun)

For example, if the user selects the roof surface edges of another three-dimensional entity (a building, etc. as an arbitrary entity around the entity selected in FIG. 3) for which the user wants to extract the entity information as shown in 410 of FIG. 4 The user terminal 110 generates a floor surface and a drawing surface (a temporary bottom surface and a temporary drawing surface) by assuming a specific value (for example, H2 = 1 m) as an initial height value of the corresponding three-dimensional entity At this time, the vertical outline (the outline of the wall surface) and the shadow of the three-dimensional object can be projected on the image map and displayed.

Since H2 = 1m does not reflect the actual height from the roof to the floor of the object, the user adjusts the height of the corresponding 3-dimensional object with the input device Or pulling the temporary drawing surface to the drawing surface of the object), all or part of the vertical outline, bottom edge point, and shadow of the projected three-dimensional object on the image map are present in the actual image map. The bottom edge corner point corresponding to one of the roof surface corner coordinates (DispX ₆ , DispY ₆ ) of the object, if adjusted to match all or part of the vertical outline, bottom edge point, and shadow of the dimension object (DispX ₇ , DispY ₇ ) and the shadow corner screen coordinates (DispX ₈ , DispY ₈ ) can be calculated as shown in Equation (7). The user terminal 110 can calculate and apply H2 of Equation (7) to a height value relative to H1 by using the above coordinate values and the conversion relation of Equation (2).

The user terminal 110 can adjust the height of the corresponding object in real time, the coordinates of the roof edge and the coordinates of the map, the coordinates of the bottom edge, By calculating coordinates, map coordinates, and shadow corner coordinates, any entity displayed on the image map can additionally display a three-dimensional shape in the form of a hexahedron represented by the roof surface and the bottom surface extending therefrom, as shown in FIG. The roof surface corner map coordinates, the bottom edge corner map coordinates, the object height H2, and the like calculated for the objects on the image map by the user terminal 110 are stored in the predetermined storage means (memory) corresponding to the corresponding object And can be used for providing various information related to the object.

In the case where the objects displayed on the video map are displayed in a three-dimensional form, the predetermined means (e.g., object information calculating means) of the user terminal 110 may display the texture of the object such as the apparent color or brightness of the object on the video map ) Feature to display the texture of the object on the roof surface or the vertical surface (wall surface) (S140). In other words, as shown in FIG. 5, not only the outline of the cube represented by the roof surface and the bottom surface extended from the object but the object selected by the user is transparently projected and displayed in three dimensions, The user terminal 110 may extract the apparent color or brightness of each pixel on the roof surface of the selected object and reflect the same on the corresponding roof surface of the cubic surface according to the pixel value, , The apparent color or brightness of each pixel may be extracted from the vertical surface (e.g., the front wall surface, the side wall surface, etc.) to be displayed and reflected on the corresponding vertical surface (wall surface) of the solid surface . The color or brightness information of the roof, the vertical surface, and the like extracted by the user terminal 110 on the objects on the image map is stored and managed in a predetermined storage unit (memory) corresponding to the corresponding object, Can be used to provide.

In this way, the user terminal 110 realizes the three-dimensional reality by displaying the roof surface of the entities selected by the user, the solid surface (hexahedron) represented by the bottom surface extended from the roof surface, and the shadow area extending from the bottom surface, Even when the display state of the video map is changed (S150), the map providing server 120 (120) changes the view state of the video map currently displayed (for example, (S151), the user terminal 110 determines whether the user wants to display the three-dimensional image on the roof surface of the user and / As shown in FIG. 5, the solid surface (hexahedron) and the shadow area extending from the bottom surface are displayed in accordance with the viewpoint or the enlargement, reduction, The object to render it can display a three-dimensional form (S160).

In addition, although the user can observe from outside the object displayed in three dimensions as described above (see 610 in FIG. 6), the observer's viewpoint may be selected as the inside of the object to view the inside of the object, (For example, the object information calculating means) 110 may display objects in a three-dimensional form without interruption by performing rendering as shown in FIG. 6 in real time even if the observation time is changed from the inside to the outside and from outside to inside S170).

For example, the inside of a three-dimensional solid surface (hexahedron) defined by the roof surface and bottom edge points of a three-dimensional object on an image map enlarged to a predetermined size or more can be used as an observation point (see 620 in FIG. 6) , A position on the video map being displayed on the user terminal 110 by the user, the position of the inside of the object to be displayed in three dimensions according to the enlargement or reduction of the video map, the change of the observation point, , MapX ₃ , MapY ₃ , H3) are located inside the cubic body defined by the roof and bottom edge points of the three-dimensional entity as described above, The user terminal 110 may perform rendering in real time to display an inner appearance (refer to 630 in FIG. 6).

In this way, the user can go inside the three-dimensional object and observe the interior of the building. In FIG. 6, the inside is transparent. However, the content image of each floor is separately constructed so that the inside appearance, Actual content may be provided. In addition, when the observation point is located inside the three-dimensional object, the operation mode of the observation point and the expression method in the three-dimensional object according to the observation point can be separately provided. For example, when the observation point is located inside the three-dimensional object, while the interior of the three-dimensional object is displayed on the screen of the user, the transparency of the inner wall of the three- The inner wall of the dimensional object and the image map corresponding to the observation point may be simultaneously displayed. At this time, a video map provided through the network may be processed so as not to be displayed.

On the other hand, the user can change the display state of the video map by changing the viewpoint of the current displayed video map (e.g., viewing the viewpoint of the corresponding position while moving in the up, down, left, and right regions) In a two-dimensional image map, such as Google Earth, Microsoft BingMap, etc., provided through a coordinate input device such as a mouse or a keyboard, through the Internet or a wireless communication network, the altitude and azimuth angle of the sun and the camera are different from those calculated above (E.g., moving from New York to Seoul, etc.) to request a map of the area (S180)

As the map providing server 120 provides the corresponding image in step S181, on the image map displayed on the user terminal 110 in step S190, the user terminal 110 repeats steps S110 through S170 on the corresponding image map A similar process can display objects in a three-dimensional form.

That is, the user on the image map, as selecting the area desired three-dimensional object information to extract the user terminal 110 2 that from the map server 120 via a network-D image map and the edge map coordinates (MapX _i, MapY _i) can be provided, and (S181), from which the user terminal 110 for the display image maps (S190) the resolution (GSD) and corner screen coordinates (DispX _i, DispY _i) and the map coordinates (MapX _i a , MapY _i ) (S110). The user calculates the azimuth angle and altitude angle information of the sun and the camera at the time of photographing the corresponding image map by designating the roof surface, the floor surface, the shadow, (S120). The calculated resolution GSD, the conversion relation, the azimuth angle and the altitude angle information of the sun and the camera are applied to other objects so that the height of the three-dimensional objects, the coordinates of the roof surface corner and the coordinates of the map, mother Li screen coordinates and map coordinates, screen coordinates shadow edges, the roof surface and a vertical surface texture information, and can display a three-dimensional object by extracting information, and that includes (S130 ~ S151). In addition, the user terminal 110 may render the three-dimensional object in accordance with various viewpoints of the observer according to the enlargement / reduction of the map, the selection of the up / down / right / (S160 to S190).

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

Resolution (GSD _x , GSD _y )
Corner map coordinates (MapX _i , MapY _i )
Corner screen coordinates (DispX _i , DispY _i )
Camera's azimuth (Acam)
The camera's elevation angle (Ecam)
The azimuth of the sun (Asun)
The altitude angle of the sun (Esun)

Claims (19)

A map processing method for extracting and displaying three-dimensional information on an object on a video map provided on a screen in a user terminal,
Calculating a resolution representing a scale factor using map coordinates of corners of the video map displayed on the screen and corner screen coordinates corresponding thereto; And
The azimuth angle and elevation angle of the sun at the time of shooting the image map, azimuth angle and elevation angle of the camera are calculated using the resolution, coordinates of the roof surface, bottom surface, and shadow of the shadowed object on the image map Extracting a three-dimensional solid surface of the object on the image map and additionally displaying the three-
And a map processing unit for processing the map. The method according to claim 1,
Wherein the user terminal is provided with the video map through a server on a wired / wireless Internet or a mobile communication network. The method according to claim 1,
In the step of calculating the resolution,
(MapX ₁ , MapY ₁ ), upper left corner map coordinates (MapX ₂ , MapY ₂ ), upper left corner screen coordinates (DispX ₁ , DispY ₁ ), and lower right corner screen coordinates (DispX ₂ , DispY ₂ )
GSD _x = (MapX ₂ - MapX ₁ ) / (DispX ₂ - DispX ₁ )
GSD _y = (MapY ₂ - MapY ₁ ) / (DispY ₂ - DispY ₁ )
(GSD _x ) in the x direction and a resolution (GSD _y ) in the y direction are calculated using the above-described method. The method of claim 3,
When the azimuth of the map coordinate system at the time of capturing the video map coincides with the azimuth of the screen coordinate system of the video map provided to the user terminal,
The relationship of the screen coordinates DispX and DispY corresponding to arbitrary map coordinates (MapX, MapY)
MapX = DispX * GSD_x + MapX_One
MapY = DispY * GSD_y + MapY_One
Of the map. The method of claim 3,
When the orientation of the map coordinate system at the time of shooting the video map does not match the orientation of the screen coordinate system of the video map provided to the user terminal,
The relationship of the screen coordinates DispX and DispY corresponding to arbitrary map coordinates (MapX, MapY)
MapX = a * DispX + b * DispY + c
MapY = d * DispX + e * DispY + f

To is determined by, wherein the transformation coefficients a, b, c, d, e, f and each of the four corner coordinate map _{(MapX i, MapY i) (} i = 1,2,3,4) and therefore the corresponding (I = 1, 2, 3, 4) of the four corner screen coordinates (DispX _i , DispY _i ) are used. The method of claim 3,
In order to calculate the azimuth angle (Asun) and altitude angle (Esun) of the sun and the azimuth (Acam) and elevation angle (Ecam) of the camera,
(DispX ₃ , DispY ₃ ) of one of the roof surfaces of the object, bottom edge corner coordinates (DispX ₄ , DispY ₄ ) on the vertical line extending from the corresponding edge screen coordinates, and shadow edges corresponding to the corresponding edge screen coordinates Using the screen coordinates (DispX ₅ , DispY ₅ )
XLen1 = (DispX ₄ - DispX ₃ ) * GSD _x
YLen1 = (DispY ₄ - DispY ₃ ) * GSD _y
Acam = assign (YLen1 / XLen1)
Ecam = atan (H1 / sqrt (XLen1 * XLen1 + Ylen1 * Ylen1))
XLen2 = (DispX ₅ - DispX ₄ ) * GSD _{x
YLen2 = (DispY 5 - DispY 4} ) * GSD y
Asun = assign (YLen2 / XLen2)
Esun = assign (H1 / sqrt (XLen2 * XLen2 + Ylen2 * Ylen2))
Wherein H1 is a height value of the corresponding object. The method according to claim 6,
And the H1 is received from a user through the user terminal. The method according to claim 6,
Wherein H1 is a virtual height value or an actual height value of the object, and when the H1 is re-input from the user, the height of the three-dimensional solid surface is updated. The method according to claim 1,
In order to calculate the azimuth angle (Asun) and altitude angle (Esun) of the sun and the azimuth (Acam) and elevation angle (Ecam) of the camera,
A floor surface, and a shadow for a corresponding object from the user through the user terminal, or the user terminal automatically designates a roof surface, a floor surface, and a shadow of the shadowed object. Map processing method. The method according to claim 1,
Wherein the step of extracting and additionally displaying the three-
An azimuth angle (Acun) and an altitude angle (Ecam) of the camera and an azimuth angle (Azim) of the sun relative to any one of the objects on the image map, Extracting and additionally displaying the height and the three-dimensional solid surface of the other object according to the height H2 or the roof surface, the floor surface, the roof surface and the shadow surface of another object designated by the user
And a map processing unit for processing the map. 11. The method of claim 10,
(DispX ₆ , DispY ₆ ), the corresponding bottom edge corner screen coordinates (DispX ₇ , DispY ₇ ), and the shadow corner screen coordinates (DispX ₈ , DispY ₈ )
DispX ₇ = DispX ₆ - (H2 / GSD _x ) * sin (Acam) / tan (Ecam)
DispY ₇ = DispY ₆ - (H 2 / GSD _y ) * cos (Acam) / tan (Ecam)
DispX ₈ = DispX ₇ - (H2 / GSD _x ) * sin (Asun) / tan (Esun)
DispY ₈ = DispY ₇ - (H 2 / GSD _y ) * cos (Asun) / tan (Esun)
Dimensional display of the other entity, wherein GSD _x is the resolution in the x direction, and GSD _y is the resolution in the y direction. 11. The method of claim 10,
When the user designates the roof surface of the other object, a temporary bottom surface and a temporary shadow surface are created on the screen. The user draws the temporary floor surface to the bottom surface of the object using the coordinate input means, And extracting and displaying the height value of the other entity and the three-dimensional solid surface with respect to the corresponding position by dragging the child surface to the shadow surface of the corresponding object. 12. The method of claim 11,
The corner map coordinates corresponding to the roof surface corner screen coordinates (DispX ₆ , DispY ₆ ), the corner map coordinates corresponding to the bottom floor corner screen coordinates (DispX ₇ , DispY ₇ ), and the height H2 of the object Means for storing and managing the map data. The method according to claim 1,
Extracting the apparent color or brightness of the roof surface and the bottom surface of the object on the image map, and reflecting the corresponding color or brightness on the roof surface and the bottom surface of the three-dimensional solid surface. 15. The method of claim 14,
Wherein the color and brightness information of the roof surface and the bottom surface of the three-dimensional solid surface are stored and managed in the storage means. The method according to claim 1,
Wherein the three-dimensional solid surface is rendered by the user in accordance with enlargement, reduction, or change in viewpoint by using the coordinate input means with respect to the image map. The method according to claim 1,
The user determines whether or not the observation point is changed inside the three-dimensional solid surface in accordance with the enlargement, reduction, or change of the viewpoint by using the coordinate input means by the user, and performs rendering in real time when changing to the inside And displays the corresponding inside of the map. 18. The method of claim 17,
If the observation time is changed to the inside, the content image for the inside of the object is provided, or the wall surface of the inside of the object is made transparent, The map processing method comprising the steps of: 1. A map processing system for extracting and displaying three-dimensional information on an object on a video map provided on a screen in a user terminal,
First calculation means for calculating a resolution indicating a scale factor using map coordinates of corners of the video map displayed on the screen and corner screen coordinates corresponding thereto;
The azimuth angle and altitude angle of the sun at the time the image map is photographed, azimuth angle and altitude angle of the camera using the resolution, and coordinates of the roof surface, bottom surface, and shadow of the shadowed object on the image map Second calculating means; And
A third calculation means for extracting and additionally displaying a three-dimensional solid surface for the individuals on the image map using the resolution, the azimuth angle and the altitude angle of the sun and the camera,
The map processing system comprising:

Images