TWI412729B - Method and system of real navigation display - Google Patents

Abstract

The invention provides a method and a system of displaying real scenery navigation, which utilizes a navigation route result integrated with the positioned information and incorporating the photography information including of azimuth angle of photography, pitch angle of scene-capture and lens focal length as projection parameters, by which the navigation information is overlapped above the photography images in a projection manner, and an interface having adjustable projection parameters is provided for increasing the correctness of overlapping to increase the effect of real scenery navigation.

Description

Real-time navigation display method and system

The invention relates to a method and a system for real-time navigation display, in particular to use the relevant parameters of photography to display with navigation information, and the projection effect of the projection method used is equivalent to what the human eye sees, so the nested on the photographic image is Real-time navigation can be completed.

Generally, the screen of the conventional navigation software, whether it is a 2D or a 3D picture, is only a schematic diagram of the road network, and the road conditions that the user actually sees are different. The user needs to associate the road network diagram with the actual road condition, which is easy for the user. Troubled. In order to solve this problem, the demand for real-life navigation is generated, which means that the navigation information is directly nested on the road conditions that the user sees, which allows the user to use WYSIWYG and use the navigation function more intuitively.

At present, there is a real-world navigation technology that overlays navigation information on road real-life images and plays them as prompts during the navigation process, such as google street view navigation. However, this technology must first establish all road real-time image database. The amount of data is too large, and most of them are located at the back end and then transmitted to the front end through the network. For instant navigation, the effect may be poor due to network relationship.

The real-life navigation technology proposed by Taiwan Patent Application 200848703 (Xinli Yilixin Communication Co., Ltd.) uses the image of the image output by the instant analysis camera to overlay the navigation information on it, but image analysis usually leads to low performance and image The effect of the analysis is also much worse when the brightness difference is too large, which will result in poor stacking.

At present, there is a real-world navigation software Wikitude Drive whose nesting method is the technique of image recognition, but this method still has the problem of using image recognition, that is, the effect of the nesting in a too bright or too dark environment is not good.

The purpose of the present invention is to realize the function of the real-life navigation and solve the current problem of the real-life navigation technology. The conventional navigation technology uses the road network diagram as an auxiliary mechanism for navigation, but the road network diagram sometimes confuses the user, and the present invention The camera is used to capture the actual road image and accurately nest the navigation data on the image to complete the real-world navigation function.

The invention also solves two problems of the current real-time navigation technology: First, the performance problem, the technology using the analysis of the instant image may lead to poor performance. Second, the problem of insufficient nesting fit is determined by the quality of the image. The method can reduce the amount of calculation without the need of image analysis, and the method provides an interface for adjusting the image nesting parameters, so that the user can adjust the effect of the nesting according to actual conditions or personal preferences. Can improve the fit of the nest.

In order to achieve the above object, a real-time navigation display system disclosed by the present invention includes: a navigation path data module, a positioning module, a spatial angle recognition module, an image acquisition module, a projection output module, and a projection adjustment module. , image nesting module. The navigation path data module is responsible for receiving road data on the navigation path, which can be obtained by the backend server or by the front end device operation. The positioning module has an instant positioning function, which can instantly obtain the current position parameters. The spatial angle recognition module is responsible for providing the azimuth and elevation angles of the image acquisition module. The image acquisition module is responsible for intercepting the live image and providing the focal length information of the lens used. The projected image module is responsible for projecting the navigation path into a planar image. The projection adjustment module is responsible for detecting and recording the adjustment of the adjustment of the projection parameters. The image nesting module is responsible for nesting the projection result on the output image of the image acquisition module.

The steps of a real-life navigation display method disclosed in the present invention are as follows:

A, get the navigation path information.

B. Obtain the azimuth, elevation angle, and lens focal length of the photograph, coordinate the position parameter information, and project the navigation path into a plane image.

C. During the navigation process, the change of the projection parameters is continuously detected and recorded.

Ding, the projection result is nested on the photographic output screen.

The method and system for real-time navigation display of the present invention are completed by combining the above modules and steps.

The foregoing and other technical features, features, and advantages of the present invention will be apparent from the description of the appended claims.

Referring to FIG. 1 , a system operation module architecture diagram of the present invention is shown. The system includes: a navigation path data module 200, which is responsible for receiving and processing navigation path data. The positioning module 201 has an instant positioning function, and can instantly obtain the current location. The spatial angle recognition module 202 is responsible for detecting the azimuth of the photographing and the pitch angle of the photograph. The projection plot module 203 is responsible for projecting the navigation path into a planar image. The projection adjustment module 204 is responsible for detecting and recording the change of the projection parameters. The image acquisition module 205 is responsible for intercepting the live image and providing the focal length of the lens. The image nesting module 206 is responsible for nesting the projection result on the output image of the image acquisition module.

Please refer to FIG. 2, which is a flowchart of the operation of the present invention, and the steps thereof include:

1. Obtain navigation path data from the front end device or from the back end server (step 100).

2. The location data is obtained by the GPS device (step 101).

3. The lens focal length is provided by the image acquisition module (step 102).

If the image acquisition module is used as a focal lens, the focal length will not change. If the zoom lens is used, the lens focal length for instant use should be provided at any time.

4. During the navigation process, the change of the projection parameters is continuously detected and recorded (step 103).

Projection parameters such as position parameter information, focal length of the lens, azimuth of the camera, pitch angle, etc., and the method of detecting the recorded projection parameters may be automatic detection, for example, the image acquisition module continuously obtains the focal length of the lens, and is recognized by the spatial space angle. The module continuously obtains the azimuth and elevation angle of the photograph; manual setting, such as changing the pitch angle of the photograph by using the change of the detected gesture, and tilting the palm forward means that the photograph is directed to the ground, and the range of the projection is close to the ground, and vice versa. The range will be close to the sky, or a simple drag element can be provided directly on the display to allow the user to directly change the pitch angle of the photograph. Another drag element can be provided to change the focal length of the lens. The parameter can be adjusted to adjust the projection. Range, such as the lens focal length is increased, you can see the farther navigation path, and vice versa, you can only see the nearer navigation route.

5. Projecting the navigation path into a planar image using projection parameters (step 104).

Using the projection parameters and the spatial position information of the navigation path, the perspective transform is used to project the spatial position information to the plane coordinates of the screen to obtain a plane image, and the plane image only needs to include the navigation path because it Provides the most important turning information for navigation.

6. The result of the projection is nested on the image output by the image acquisition module (step 105).

The above is a detailed description of the embodiments of the present invention, but is not intended to limit the scope of the other embodiments of the present invention. It should be included in the patent scope of the present application.

The invention provides the following advantages when compared with other conventional technologies:

1. Use instant photography to achieve real-world navigation, making the navigation function more intuitive and easy to use. The advantage of using a camera is that even if the user distracts to view the navigation screen, the user can still see the real-time road condition through the camera, thereby reducing the danger caused by viewing the navigation screen. In addition, because the navigation screen has only the immediate front road condition and navigation path, there is no complicated information, which allows the user to easily understand the direction of the guide.

2. Open the interface of adjustable projection parameters to make the nesting function more flexible. This function can improve the fit of the image nesting by adjusting parameters such as pitch angle, direction angle, etc., so that it is closer to the actual road condition, or because the camera's visual distance is sometimes not far enough, and the speed is too fast, it will make The user has no time to react. At this time, the projection range can be increased by changing parameters such as the focal length of the lens, so that the user can see the navigation path further away to avoid this problem.

In summary, the present invention is not only innovative in terms of technical ideas, but also can enhance the above-mentioned plurality of functions compared with conventional articles, and should fully comply with the statutory invention patent requirements of novelty and progressiveness, and submit an application according to law, and invites you to approve the invention. Patent application, in order to invent, to the sense of virtue.

100. . . Obtain path planning information

101. . . Get location data

102. . . Obtaining the parameters of photography

103. . . Detecting the green projection parameter

104. . . Project the navigation path into a plane

105. . . Nesting the projection result on the photographic output screen

200. . . Navigation data module

201. . . Positioning module

202. . . Spatial angle recognition module

203. . . Projection graph module

204. . . Projection adjustment module

205. . . Image acquisition module

206. . . Image nesting module

Please refer to the following detailed description of the process and the accompanying drawings for the present invention, and the technical contents of the present invention and its effects can be further understood:

Figure 1 is a block diagram of a system module of the present invention;

Figure 2 is a flow chart of the method of the present invention.

200. . . Navigation data module

201. . . Positioning module

202. . . Spatial angle recognition module

203. . . Projection graph module

204. . . Projection adjustment module

205. . . Image acquisition module

206. . . Image nesting module

Claims (2)

A method for real-time navigation display, the steps comprising: a. obtaining navigation path data, including spatial location information of the path and road name, the data is known by the back-end server; b. obtaining positioning data; c. obtaining parameters of photography The parameter includes the pitch angle of the photographing, the azimuth of the photographing, and the focal length of the photographing lens; d. detecting and recording the change of the projection parameter, the detecting is to provide a simple component for setting on the screen, such as a dragging component; The navigation path data is outputted by the projection module; and f. the projection result is nested on the image acquisition module output screen. A system for real-time navigation display, comprising: a navigation path data module, which is responsible for receiving navigation path data, including road space location information and road name on the navigation path, which can be obtained by a back-end server; a positioning module having Instant positioning function, which can instantly obtain the current location information; a spatial angle recognition module is responsible for detecting the azimuth and elevation angle of the photography, such as using an electronic compass to obtain the azimuth and using the direction sensor or the gyroscope to obtain the photography. Pitch angle; an image acquisition module, responsible for intercepting the instant image and providing the focal length information of the lens used therein, is a camera; a projection adjustment module is responsible for detecting the change of the green projection parameter, which is on a screen a component; a projection image module, responsible for projecting the navigation path into a planar image; And an image nesting module, which is responsible for nesting the result of the projection on the output image of the image acquisition module.