KR20060064483A - Server for providing a route information using moving picture and a method for providing a route information using moving picture - Google Patents

Abstract

The present invention relates to a server for providing actual video path information and a method for providing video path information, wherein a user transmits information on a destination, a departure point, or a region of interest to a server through a personal terminal. The server calculates a route between the starting point and the destination by using the link and node information constituting the road network, extracts the corresponding videos using the video index table and the camera index table, and combines the extracted videos. To generate video path information in the form of stream. By providing the path information of the actually recorded video to the user through the personal terminal, the user can feel more realistic and can easily read the path.

Video, link, node, path, camera index table, video index table, mapping table

Description

Provide server route information {Server for providing a route information using moving picture and a method for providing a route information using moving picture}

1 is a block diagram illustrating a video path information providing server according to a preferred embodiment of the present invention.

2 is a flowchart illustrating a method for providing video path information according to an exemplary embodiment of the present invention.

3 is an exemplary diagram of a road network for explaining a path extraction process.

4 is an index table for explaining a video search process.

5 is an exemplary diagram for explaining an example of a line degraph for path extraction.

<Explanation of symbols for the main parts of the drawings>

10: input / output unit

20: path calculator

30: search unit

40, 50: database

The present invention relates to a video path information providing server and a video path information providing method, and more particularly, to a server for providing actually captured video path information and a path information providing method.

In general, a navigation system is mounted on a moving object such as a car, a ship, an aircraft, etc., and uses a location information received from a position measuring device (hereinafter, referred to as a GPS) to determine the current position, direction of travel, speed of travel, and distance to a destination. And various kinds of information necessary for calculating the optimal route and the like and displaying the driving route on a two-dimensional map.

Conventional navigation systems generate route information between a starting point and a destination, display the generated route information as a two-dimensional map of points and lines on a screen, and provide guide information through a screen or a speaker. At this time, route information is generated through application program logic operated in information center or navigation system.

However, in the conventional navigation system, as the route information is symbolically displayed in a two-dimensional map, it is sometimes difficult for a user to read the route information accurately and quickly at a complicated intersection. Therefore, there is a need for the development of a system that can more intuitively read and provide realistic path information.

An object of the present invention is to provide a video path providing server and a video path providing method for providing the path information between the starting point and the destination in the actual captured video.

The video path information providing server of the present invention for achieving the above object comprises a first database storing link and node information, a video of each link, a second database storing a video index table and a camera index table for the video, A processor for calculating a route between a starting point and a destination using link and node information stored in a first database, and using the video index table and a camera index table for the links on the calculated route, the corresponding videos from the second database. And a search unit which extracts and combines the extracted videos to generate video path information.

In addition, the method for providing video route information according to the present invention for achieving the above object comprises the steps of receiving a starting point and a destination, calculating a route between the starting point and a destination, extracting corresponding videos for the links on the calculated route; And generating video path information by combining the extracted videos.

The calculating of the route may include: searching for a link closest to the source, searching for a node connected to the link, searching for one link connected to the destination direction among the links connected to the node, and And sequentially searching for links and nodes connected to the nearest link from the destination.

The extracting of the video may include searching camera index tables including positions of links of the calculated path, searching video index tables corresponding to the searched camera index tables using a mapping table, and video searching table. And extracting videos of the corresponding location with reference to the drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The following embodiments are provided to those skilled in the art to fully understand the present invention, and may be modified in various forms, and the scope of the present invention is not limited to the embodiments described below. .

1 is a block diagram illustrating a video path information providing server according to a preferred embodiment of the present invention.

The video path information providing server of the present invention has a configuration of a general server including a central processing unit (CPU), an input / output device, a storage device, a communication module, and the like through a wired or wireless communication network, an internet network, a mobile communication network, and the like. It can be connected to a personal terminal such as a computer (PC), PDA, mobile phone, navigation device, telematics device, etc., which can be implemented. As a mobile communication network, PCS communication system, IS-95A, 95B, 95C communication system which are widely used at present, or digital cellular communication using code division multiple access (CDMA) method such as IMT-2000 and UMTS It can be a system.

In addition, the video path information providing server of the present invention further includes an input / output unit 10, a path calculating unit 20, a search unit 30, and a database 40 and 50 to provide video path information according to the present invention. do.

The input / output unit 10 receives a starting point and a destination transmitted from a personal terminal, and transmits the video path information generated according to the present invention to the personal terminal.

The database 40 stores link information representing roads of a road network, geometric information representing a centerline of a road, node information representing an intersection, and the like. At this time, the link and node information is stored in the database 40 as coordinate values (x, y). That is, the link is stored as a coordinate value (x, y) of a start point (node) and an end point (node), and the node is stored as a coordinate value ((x, y) of a point. It may include information such as road type, route number, speed limit, etc. Also, a set of all consecutive points of the link information ((x1, y1) .... (to indicate the shape of the link). xn, yn)).

The database 50 stores a video corresponding to each link, a video index table, a camera index table, a mapping table, and the like for the video. The camera index table includes position information and attitude information of a camera, and the video index table includes a storage position of a video and frame count information (time information) per second of the video, and the mapping table includes the camera index table and the Contains location information of the video index table.

The route calculating unit 20 calculates a route between a starting point and a destination using link information and node information stored in the database 40. The calculated route includes link and node information connected from the link closest to the source to the link closest to the destination.

The search unit 30 extracts the corresponding videos from the database 50 by using the video index table and the camera index table for the links of the calculated path, and combines the extracted videos to provide video path information. Create

Next, a process of providing video path information through the video path information providing server of the present invention configured as described above will be described in detail with reference to FIGS. 2 to 4.

First, the user inputs desired starting and destination information through the personal terminal while the user connects the personal terminal to the video path information providing server of the present invention through a predetermined communication network (step S10). If the telematics device or personal terminal (navigation terminal) can report the current location to the server, the server may provide video information corresponding to the location.

When the starting point and destination information is input through the input / output unit 10 of the server, the route calculating unit 20 calculates a route between the starting point and the destination (step S20). Here, the process of extracting the path by the path calculator 20 will be described in detail with reference to FIG. 3.

First, the route calculating unit 20 searches for the link L1 nearest to the starting point S. FIG. After searching for the node N1 connected to the link L1, the shortest link L2 connected to the destination T is searched among the links connected to the node N1. In this manner, the links L2 to L8 and the nodes N2 to N7 connected to the link closest to the destination T are sequentially searched. At this time, the lane of the road may be distinguished by referring to the geometric information.

In FIG. 3, the links L2 to L7 refer to links having a shorter distance than other links connected to the nodes N2 to N7. When the route is calculated in this manner, the shortest route between the starting point and the destination is obtained. Can be. However, by adding the top speed information of the road as well as the distance information to the link, and applying this, it is also possible to calculate a route that can arrive in a short time.

In the present embodiment, a path calculation process is described as an example with reference to FIG. 3, but path search algorithms commonly known in the art may be appropriately used.

When the path is calculated in step S20, the search unit 30 searches for corresponding videos in the database 50 with respect to the links L1 to L8 of the calculated path (step S30). The process of extracting the video by the search unit 30 will be described in detail with reference to FIG. 4 as follows.

The search unit 30 includes a camera index table CT 1 including positions of the links L1 to L8 of the calculated path, that is, coordinates (x, y) of a start point (node) and an end point (node) of each link. To CT 8), and then search the moving picture index tables PT 1 to PT 8 corresponding to the searched camera index tables (CT 1 to CT 8) using the mapping tables MT 1 to MT n. Then, the moving picture (V1 to V8) of the corresponding position is extracted with reference to the moving picture index table (PT 1 to PT 8).

The camera index tables CT 1 to CT n and the video index tables PT 1 to PT n are made, for example, in units of 1 second in the process of photographing the videos V1 to Vn. The positions of the tables CT 1 to CT n and the moving picture index tables PT 1 to PT n are indexed in the mapping tables MT 1 to MT n. In addition, the camera index table CT 1 to CT n includes position information (x, y, z) and posture information (Omega, Phi, Kappa) of the camera at the time of shooting, and the video index table PT 1 to PT. n) includes the storage location information (LO 1 to LO k) of the video (V1 to Vn) and the number of frames per second (time information) of the video. The position information (x, y, z) can be obtained using, for example, a Global Positioning System (GPS), and the attitude information (Omega, Phi, Kappa) is, for example, GPS and an INS (Inertial Navigation System). Can be obtained by integrating

Accordingly, the camera index tables CT 1 to CT 8 including the positions of the links L1 to L8 of the calculated path, that is, the coordinates (x, y) are searched, and the mapping tables MT 1 to MT n are replaced. Video (V1 to V8) for the links (L1 to L8) of the calculated route by searching the video index table (PT 1 to PT 8) corresponding to the searched camera index table (CT 1 to CT 8) by using Can be extracted.

When all of the videos V1 to V8 for the links L1 to L8 are extracted in step S30, the extracted video paths V1 to V8 are combined to generate video path information (step S40). At this time, since the time for extracting the videos V1 to V8 may be different, the extracted videos V1 to V8 are combined in the order of the links L1 to L8 when all the videos V1 to V8 are extracted. . Through this process, the video path information from which the video V1 to V8 from the starting point S to the destination T is combined into one stream is generated.

The video path information generated by the search unit 30 is transmitted to the personal terminal through the input / output unit 10 (step S50). The route information from the starting point S to the destination T is displayed as a video actually captured on the screen of the personal terminal. At this time, if the video (V1 to Vn) is constructed according to a video standard such as MPEG 4, for example, various information about roads, buildings, facilities, etc. can be inserted into the video in the form of a tag (text information), for example. have.

In order to obtain a moving image of the present invention, a CCD image acquisition vehicle 4S-Van capable of acquiring images of actual roads and facilities and constructing 3D spatial information may be used, or a personal (portable) camcorder may be used. However, when using a portable camcorder, GPS or INS must be used separately to obtain camera position information and attitude information.

4S-Van has four system technologies that share 4S technologies such as geographic information system (GIS), satellite positioning system (GNSS), spatial image information system (SIIS), and spatial information of intelligent transportation system (ITS). It is a vehicle used for the vehicle, and it is a hardware part including a sensor unit and a data storage unit such as a global positioning system (GPS), an inertial measurement unit (IMU), a color CCD camera, a monochrome CCD camera, and an infrared camera, and inputs from each sensor. GPS / IMU integrated algorithm that integrates and analyzes the collected data, integrates data input from each sensor through coordinate transformation and correction of lens / camera posture, calculation and correction of external facial expression for each CCD image, It consists of a piece of software that analyzes and processes.

When the video is acquired by using a 4S-Van vehicle or a portable camcorder, the initial video and the CCD image are corrected, and the mapping table is constructed and stored in the database using the camera index table and the video index table generated during the shooting process. do.

The database DB may be constructed by linking geometric information of a conventional two-dimensional digital map, three-dimensional additional information, a bottom height on a digital elevation model (DEM) of a building, and a height of a building. The property information of these buildings and facilities can be constructed through the relevant building ledger and field survey. Using a built-in database (DB), it is possible to model the facility by generating three-dimensional geometric information through three-dimensional extrusion (extrusion) in a two-dimensional cross section.

In addition, in the present invention, by using the optimal path extraction algorithm reflecting the U-turn, P-turn, prohibition of turn, etc. for the optimal path extraction, it is possible to minimize the impairment of traffic communication due to the waiting queue of the vehicle to turn left at the intersection. have.

As a general path search method, a graph theory corresponding to a road network may be applied by applying graph theory. Applying the graph theory, links and nodes in the road network refer to nodes and edges in the graph, and each edge has a weight, or cost, that is required to pass for path search. The path extraction algorithm has a cost value (c _ij ) required to pass node j from node i as a weight of edge (i, j) ∈ E (all edges to be path searched in the graph), G = (N, E), there is a travel cost value from edge a to edge b, i.e. penalty σ _ab (≥ 0), for successive edges a = (i, j) and edge b = (j, k) on G In this case, the penalty is as follows.

Positive numbers with σ _ab ≥ 0: passable

σ _ab = ∞: curfew

Approaches to solve the rotation problem in road networks include node expansion, dual graphs, and line digraphs that add dummy nodes and edges to intersection nodes of the road network. There is a method using. In the present invention, a line degraph may be configured and processed for path extraction.

5 is an exemplary diagram for describing an example of a line degraph.

For graph G for road network, line degraph D = L (G) is the node set and edge set E (D) = {ab: a where the links in road network graph G become nodes and N (D) = E (G) , b ∈ N (D), the beginning of a and the end of b agree. A Dijkstra algorithm, which is an optimal path extraction algorithm, may be performed on a line diagram graph D converted from a given road network graph G.

In addition, the present invention may use a spatial index structure that is generally used to quickly search for the video of the link corresponding to the current driving position (GPS position). The spatial index structure divides the links constituting the road network into a minimum bounding rectangle (MBR) that surrounds the spatial object. Add the buffer (b _k ) information for the link to the minimum rectangle (MBR) of the lowest node in the tree. Therefore, there are two main steps to searching for videos for a specific link.

Step 1: Retrieve buffer (b _k ) information for a link belonging to a user's current driving position.

Step 2: Search the camera index table CT including the camera position information (x, y, z) closest to the current driving position, and search the video index table PT using the corresponding mapping table MT. . The video frame is extracted according to the storage location information of the video index table PT.

Here, the position of the video frame may be calculated by using Equation 1 below using the storage interval and the frame information of the video.

Frame position = (frames per second of movie) × (closest camera index table)

For example, if camera information about a movie is stored at 1-second intervals, and the movie was shot at 30 frames per second, and the closest camera index table (CT) is fifth, the frame position within that movie is 30 × 5. = 150 frames. Therefore, by transmitting a video from the frame it can provide a video of the road closest to the driving position.

As described above, the preferred embodiment of the present invention has been disclosed through the detailed description and the drawings. The terms are used only for the purpose of describing the present invention and are not used to limit the scope of the present invention as defined in the meaning or claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

As described above, in the present invention, when a user transmits information of a destination and a starting point or a region of interest to a server through a personal terminal, the server calculates a route between the starting point and the destination using link and node information constituting a road network. The extracted video clips are extracted using the video index table and the camera index table for the links of the calculated paths, and then the extracted video clips are combined into a stream to generate video path information. Therefore, the user can feel the reality and can easily read the path by providing the video path information actually recorded to the user through the personal terminal. The video path information can be provided without changing the structure of the user terminal or the operating program.

Claims (12)

A database storing link and node information and a video of each link, A processor configured to calculate a route between a starting point and a destination using the link and node information; And a search unit which extracts corresponding videos from the database for the links on the calculated path, and combines the extracted videos to generate video path information. The video path information providing server of claim 1, wherein the path includes link and node information connected from a link closest to the source to a link closest to the destination. The video path information providing server of claim 1, wherein the link information includes geometric information. The video path information providing server of claim 1, wherein the searcher extracts the corresponding videos using index tables. 5. The moving picture of claim 4, wherein the index tables are a moving picture index table and a camera index table for a moving picture of each link, and a mapping table including position information of the moving picture index table and the camera index table. Route information server. 6. The video path information providing server according to claim 5, wherein the video index table includes storage position and time information of the video, and the camera index table includes position information and posture information of the camera. The video path information providing server of claim 1, further comprising an input / output unit configured to receive the starting point and the destination and output the video path information. Calculating a route between origin and destination, Extracting corresponding videos for the links on the calculated path, And combining the extracted moving pictures to generate moving picture path information. The method of claim 8, wherein the calculating of the route comprises: a) searching for a link closest to the origin; b) searching for nodes associated with the link, c) searching for one of the links connected to the node in the direction of the destination; d) sequentially searching for links and nodes connected to the link closest to the destination by the method of steps b) and c). The method of claim 8, wherein the extracting of the video comprises: a) searching camera index tables including positions of links of the calculated path; b) searching video index tables corresponding to the found camera index tables using a mapping table; c) extracting moving images of a corresponding position by referring to the moving image search tables. The camera index table of claim 10, wherein the camera index table includes position information and attitude information of a camera, the video index table includes storage position and time information of the video, and the mapping table includes the camera index table and the video. Video path information providing method comprising the position information of the index table. The method of claim 8, wherein the searched moving pictures are combined in the order of the links.

Images