CN102829788A - Live action navigation method and live action navigation device - Google Patents

Live action navigation method and live action navigation device Download PDF

Info

Publication number
CN102829788A
CN102829788A CN2012103093526A CN201210309352A CN102829788A CN 102829788 A CN102829788 A CN 102829788A CN 2012103093526 A CN2012103093526 A CN 2012103093526A CN 201210309352 A CN201210309352 A CN 201210309352A CN 102829788 A CN102829788 A CN 102829788A
Authority
CN
China
Prior art keywords
image
user
action
real
uo
Prior art date
Application number
CN2012103093526A
Other languages
Chinese (zh)
Inventor
韩钧宇
邓超
吕赛
Original Assignee
北京百度网讯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京百度网讯科技有限公司 filed Critical 北京百度网讯科技有限公司
Priority to CN2012103093526A priority Critical patent/CN102829788A/en
Publication of CN102829788A publication Critical patent/CN102829788A/en

Links

Abstract

The invention provides a live action navigation method and a live action navigation device. The live action navigation method comprises the following steps of: obtaining a real image I of the current scene of a user from a user image collection device; obtaining an image, which corresponds to a geographic position at a distance from the current geographic position of the user in a predetermined range, from a network image database so as to form an image data set U; transmitting the real image I and the image data set U to an image matching system, and obtaining an image U0 in the image data set U, which has highest matching degree to the real image I, from the image matching system; determining orientation information of the image U0 from the network image database, and determining a route of the user by utilizing the orientation information, a geographic position B and an action path from the current geographic position B of the user to a destination A. According to the invention, the route to the destination can be conveniently selected by the user, and the data quantity received by a mobile terminal is reduced.

Description

一种实景导航方法和实景导航装置 One kind of real real navigation method and a navigation device

【技术领域】 TECHNICAL FIELD

[0001] 本发明涉及计算机应用技术领域,特别涉及一种实景导航方法和实景导航装置。 [0001] The present invention relates to a computer application technology, and more particularly, to a navigation method and a real real navigation device. 【背景技术】 【Background technique】

[0002] 随着电子地图导航系统的发展,为人们的出行带来了极大的方便,其通常采用基于卫星定位信号、无线通信网络或者WIFI网络定位用户当前的地理位置,采用动态规划的方式规划出用户的行动路径。 [0002] With the development of electronic map navigation systems, has brought great convenience for people to travel, it is usually by way of satellite-based positioning signals, wireless communications network or WIFI network locate the user's current location, using dynamic programming planning the path of the user's actions.

[0003]目前大多数使用的是基于二维(2D)的俯视逻辑地图,但在实际应用中,当用户到达岔道路口时,导航地图只能给出规划路线,而不能给用户实时指明当前选择的具体路口,由于2D的俯视逻辑地图与用户所处的真实环境有很大差距,还是需要用户经过方向判别,这对于方向感较差的用户来说还是很难做出正确的选择。 [0003] Most currently used is based on two-dimensional (2D) top logical map, but in practice, when the user reaches the fork intersection, the navigation map can only give directions, rather than give users real-time specified in the current selection specific intersection, because the top logical map with a user's real environment in which there is a big gap between 2D, users still need to go through orientation discrimination, which for a poor sense of direction of users is still very difficult to make the right choice. [0004] 之后为了使得电子地图与人真实所处的环境更好的匹配,在电子地图导航系统中提供了街景服务,街景是采用照相机360度拍摄人们所处的某一时刻的静态3D图像,给人们一种直观的地图视觉享受。 After [0004] In order to make electronic maps of the environment in which the real people a better match, Street View provides an electronic map navigation system, the street is the use of 3D camera 360 degrees to capture still images at a time in which the people, to give people an intuitive visual map. 然而街景图像是预先拍摄的,由于用户所处角度的差别,街景与用户实际所处的场景存在差别,需要用户自己定位所处场景对应街景的哪个位置,同样对于用户选择行动方向来说存在难度,并且移动端接收全视角的街景图像数据量过大。 However streetscape image is captured in advance, due to the difference in which the angle of the user, and the user's actual street scenes in which there are differences, which requires the user to locate the position of which corresponds to the scene of their own street, there is the same difficulty for the user to select the direction for action and the mobile terminal receiving the full angle of the image data is too large street.

【发明内容】 [SUMMARY]

[0005] 本发明提供了一种实景导航方法和实景导航装置,以便于方便用户选择到达目的地的行动方向,减少移动端接收的数据量。 [0005] The present invention provides a navigation method and a real real navigation device, in order to reach the destination of action in user selection, reduce the data amount received by the mobile terminal.

[0006] 具体技术方案如下: [0006] The specific technical solution is as follows:

[0007] 一种实景导航方法,该方法包括: [0007] A real navigation, the method comprising:

[0008] SI、从用户图像采集装置获取用户当前所处场景的实景图像I ;以及,从网络图像数据库中获取距离用户当前所处地理位置B在预设范围内的地理位置所对应的图像,构成图像数据集U ; [0008] SI, acquires the user from the user image capture device is currently located in the real scene image I; and, obtaining from the user from the network geographic image database the image B is currently located in the geographical location corresponding to a preset range, constituting the image data set U;

[0009] S2、将实景图像I和图像数据集U发送给图像匹配系统,并从图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像UO ; [0009] S2, the real image I and the image data sets to the image matching system U, U, and acquires image data set with the highest degree of matching real image I UO image from an image matching system;

[0010] S3、确定网络图像数据库中图像UO的朝向信息,利用该朝向信息、地理位置B以及从用户当前所处地理位置B到目的地A的行动路径,确定用户的行动方向。 [0010] S3, the orientation information to determine the image database the image UO network, with which the orientation information, from the user's current location B and route B to the geographical location of the destination mobile A, the direction of the user's action is determined.

[0011] 根据本发明一优选实施例,该方法还包括: [0011] According to a preferred embodiment of the present invention, the method further comprising:

[0012] 将所述行动路径、行动方向以及将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统进行展示,其中所述行动方向展示在实景图像I上;或者, [0012] The information of the action toward the path of action, and the image orientation information as UO real image I is transmitted to the user interface display control system, wherein the action direction of the image displayed on the real I; or

[0013] 将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统,用于展示在所述行动路径的展示界面上;或者, [0013] UO toward the image information transmitted real image I as the orientation information to a user interface control system, an interface for displaying on said display action path; or

[0014] 将所述行动方向发送给用户界面控制系统,用于展示在所述的行动路径的展示界面上。 [0014] the course of action to send to the user interface control system for display on the display screen of the action path. [0015] 根据本发明一优选实施例,该方法还包括: [0015] According to a preferred embodiment of the present invention, the method further comprising:

[0016] 接收来自用户界面控制系统的实景导航请求,该实景导航请求中包含目的地A的 [0016] from a user interface control system real navigation request, the request includes a destination virtual navigation of A

信息; information;

[0017] 从用户定位系统获取用户当前所处的地理位置B ; [0017] acquiring the current user B from the user's geographical location positioning system;

[0018] 将从出发地B至目的地A的路径请求发送给网络导航系统,并获取网络导航系统返回的行动路径。 Path [0018] B from the departure point to the destination network A sends a request to the navigation system and the navigation system acquires action return path network.

[0019] 根据本发明一优选实施例,所述行动路径为最优路径。 [0019] According to a preferred embodiment of the present invention, the optimal path is the path of action.

[0020] 根据本发明一优选实施例,在所述步骤S3中,所述朝向信息为基于地理位置B的方向向量,确定所述行动路径基于地理位置B的方向向量,通过确定这两个方向向量的差异得到用户的行动方向。 [0020] According to a preferred embodiment of the present invention, in the step S3, the orientation information is the orientation vector based on the location B, to determine the action path based on the vector direction B of the location, the two directions is determined by difference vectors of action to get the user.

[0021] 根据本发明一优选实施例,该方法还包括: [0021] According to a preferred embodiment of the present invention, the method further comprising:

[0022] 将图像UO中的重要地理目标匹配到图像I中的对应区域,并将对应区域的位置发送给用户界面控制系统进行展示。 [0022] UO important images in a geographic target area is matched to a corresponding image I, and transmits to the user interface control system corresponding to the placement area.

[0023] 根据本发明一优选实施例,所述将图像UO中的重要地理目标匹配到图像I中的对应区域具体包括: [0023] According to a preferred embodiment of the present invention, the important images in a geographic target UO matched to the corresponding region of image I comprises:

[0024] 基于局部特征的相似度,将图像UO中重要地理目标的局部特征向图像I投影,如果投影位置的方差小于或等于预设的方差阈值,则将投影位置的期望确定为图像UO中的重要地理目标在图像I中的对应区域的位置。 [0024] Based on the similarity of local features, local feature image UO important to a geographic target image I projected, the projection position if the variance is less than or equal to a preset threshold variance value, then the desired position is determined as the projected image of UO the important geographical position of the target image I in the corresponding area.

[0025] 一种实景导航装置,该装置包括: [0025] A real navigation device, the apparatus comprising:

[0026] 实景图像获取单元,用于从用户图像采集装置获取用户当前所处场景的实景图像I ; [0026] The photographed image acquisition unit for acquiring a user from a user image capture device is currently located in the real scene image I;

[0027] 网络图像获取单元,用于从网络图像数据库中获取距离用户当前所处地理位置B在预设范围内的地理位置所对应的图像,构成图像数据集U ; [0027] Network image acquiring unit for acquiring an image from the user's current geographic location B location within a predetermined range corresponding to the configured set of image data from the network U image database;

[0028] 匹配图像获取单元,用于将实景图像I和图像数据集U发送给图像匹配系统,并从图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像UO ; [0028] matching image acquisition unit for the real image I and the image data sets U to the image matching system, and acquires the image data set U UO image with the highest matching degree from the image I real image matching system;

[0029] 行动方向确定单元,用于确定网络图像数据库中图像UO的朝向信息,利用该朝向信息、地理位置B以及从用户当前所处地理位置B到目的地A的行动路径,确定用户的行动方向。 [0029] The mobile direction determination unit toward the image database the image information network UO for determining, by using the orientation information from the user's current location B and route B to the geographical location of the destination mobile A is determined that the user's actions direction.

[0030] 根据本发明一优选实施例,该装置还包括: [0030] According to a preferred embodiment of the present invention, the apparatus further comprising:

[0031] 界面交互单元,用于将所述行动路径、行动方向以及将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统进行展示,其中所述行动方向展示在实景图像I上;或者, [0031] The interactive interface unit for transmitting information toward the path of action, and the image of action as UO I photographed image orientation information to a user interface control system for display, wherein the display of action in real the image I; or

[0032] 将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统,用于展示在所述行动路径的展示界面上;或者, [0032] UO toward the image information transmitted real image I as the orientation information to a user interface control system, an interface for displaying on said display action path; or

[0033] 将所述行动方向发送给用户界面控制系统,用于展示在所述的行动路径的展示界面上。 [0033] the course of action to send to the user interface control system for display on the display screen of the action path.

[0034] 根据本发明一优选实施例,该装置还包括: [0034] According to a preferred embodiment of the present invention, the apparatus further comprising:

[0035] 界面交互单元,用于接收来自用户界面控制系统的实景导航请求,该实景导航请求中包含目的地A的信息;[0036] 位置获取单元,用于从用户定位系统获取用户当前所处的地理位置B ; [0035] The interactive interface unit to receive a request from the user interface photo navigation control system, the destination information A real navigation request comprising; [0036] The position obtaining unit configured to obtain, from a user is currently located positioning system location B;

[0037] 路径获取单元,用于将从出发地B至目的地A的路径请求发送给网络导航系统,并获取网络导航系统返回的行动路径。 [0037] The route retrieval unit, for the path B from the departure point to the destination network A sends a request to the navigation system and the navigation system acquires action return path network.

[0038] 根据本发明一优选实施例,所述行动路径为最优路径。 [0038] According to a preferred embodiment of the present invention, the optimal path is the path of action.

[0039] 根据本发明一优选实施例,所述朝向信息为基于地理位置B的方向向量,所述行动方向确定单元确定所述行动路径基于地理位置B的方向向量,通过确定这两个方向向量的差异得到用户的行动方向。 [0039] According to a preferred embodiment of the present invention, the orientation information is direction vector based on the location B, the mobile direction determination unit determines the action path based on the vector direction B of the geographic location by determining the two direction vectors differences get action direction of the user.

[0040] 根据本发明一优选实施例,该装置还包括: [0040] According to a preferred embodiment of the present invention, the apparatus further comprising:

[0041] 目标匹配单元,用于将图像UO中的重要地理目标匹配到图像I中的对应区域; [0041] target matching unit, configured to image the important target UO is matched to a corresponding geographical area in the image I;

[0042] 界面交互单元,用于将所述对应区域的位置发送给用户界面控制系统进行展示。 [0042] The interactive interface unit for transmitting the position of the region corresponding to the control system to the user interface display.

[0043] 根据本发明一优选实施例,所述目标匹配单元在执行所述匹配的操作时,具体基于局部特征的相似度,将图像UO中重要地理目标的局部特征向图像I投影,如果投影位置的方差小于或等于预设的方差阈值,则将投影位置的期望确定为图像UO中的重要地理目标在图像I中的对应区域的位置。 Similarity [0043] According to a preferred embodiment of the present invention, the target matching unit, when performing the matching operation, based on the specific local features, local feature image UO important to a geographic target image I projected, if the projection the position of the variance less than or equal to a preset threshold variance value, then a desired projected position as a position corresponding to the target image region important geo UO in the image I.

[0044] 由以上技术方案可以看出,通过本发明所提供的方法和装置,用户仅需要将当前所处场景的实景图像进行上传变可以获知行动方向,无需用户依据地图中的路线额外进行方向判别,对于方向感较差的用户而言,显然十分简单方便。 [0044] As can be seen from the above technical solutions, the method and apparatus provided by the present invention, the user only needs to which the real image of the current scene may be learned upload variant of action without user direction based on additional map route discrimination, poor sense of direction for the user, obviously very simple and convenient. 另外本发明中不需要用户通过移动端上传和接收3D街景图像,显然大大减少了移动端的数据量传输。 Also the present invention does not require a user to upload and receive 3D panoramic image by moving the end, obviously greatly reduces the amount of data the mobile terminal.

【附图说明】 BRIEF DESCRIPTION

[0045] 图I为本发明实施例所应用的系统架构示意图; [0045] Figure I a schematic diagram of a system architecture of the present embodiment of the invention is applied;

[0046] 图2为本发明实施例一提供的实景导航方法流程图; [0046] FIG 2 real navigation method according to a first embodiment of the present invention, a flow chart;

[0047] 图3为本发明实施例提供的一个实例场景图; [0047] FIG. 3 an example scene graph according to an embodiment of the present invention;

[0048] 图4为本发明实施例提供的实例场景图中的最优路径示意图; [0048] FIG 4 illustrates an example scene graph provided in the embodiment of the invention the optimum path;

[0049] 图5为本发明实施例提供的实景图像的逻辑示意图; [0049] FIG. 5 schematic photographed image according to an embodiment of the present invention;

[0050] 图6为本发明实施例提供的匹配到的图像UO的示意图; [0050] FIG. 6 is a schematic of the matched image provided UO embodiment of the invention;

[0051] 图7为本发明实施例提供的行动方向的示意图; [0051] FIG. 7 is a schematic of action according to an embodiment of the present invention;

[0052] 图8为本发明实施例提供的用户再次拍摄的实景图像的逻辑示意图; [0052] FIG. 8 is a schematic diagram user photographed image photographed again provided in embodiments of the present invention;

[0053] 图9为本发明实施例提供的用户再次得到的行动方向的示意图; [0053] FIG. 9 is a schematic view of the direction of action provided by the user once again embodiment of the invention;

[0054] 图10为本发明实施例提供的重要地理目标的示意图; [0054] FIG. 10 is a schematic embodiment of a geographic target important embodiment of the present invention provides;

[0055] 图11为本发明实施例二提供的实景导航装置的结构图。 [0055] FIG 11 FIG real configuration of the navigation device according to a second embodiment of the invention.

【具体实施方式】 【Detailed ways】

[0056] 为了使本发明的目的、技术方案和优点更加清楚,下面结合附图和具体实施例对本发明进行详细描述。 [0056] To make the objectives, technical solutions, and advantages of the invention more apparent, the accompanying drawings and specific embodiments of the present invention will be described in detail with.

[0057] 本发明提供的方法和装置应用于如图I所示的系统架构下,主要包括:网络导航系统、网络图像数据库、用户定位系统、用户图像采集装置、图像匹配系统、用户界面控制系统和系统控制中心。 [0057] The present invention provides a method and apparatus is applied to the system architecture shown in FIG. I, the primary comprising: a network navigation system, an image database network, the system user location, a user image capture apparatus, an image matching system, a user interface control system and system control center.

[0058] 实施例一、[0059] 图2为本发明实施例一提供的实景导航方法流程图,如图2所示,该方法主要包括以下步骤: [0058] Example I. [0059] FIG 2 is a flowchart of a method according to a first real navigation of the invention shown in Figure 2, the method includes the following steps:

[0060] 步骤201 :系统控制中心接收来自用户界面控制系统的实景导航请求,该实景导航请求包含目的地A的信息。 [0060] Step 201: Virtual navigation system control center receives a request from the user interface of the control system, the real navigation request contains information of the destination of A.

[0061] 用户能够通过用户界面控制系统请求从当前位置到目的地A的导航路径,即通过用户界面控制系统向系统控制中心发送包含目的地A的信息。 [0061] The user can request the navigation route from the current position to the destination A control system through the user interface, i.e., the transmission comprising destination information A to the system control center via the user interface control system.

[0062] 步骤202 :系统控制中心从用户定位系统获取用户当前所处的地理位置B。 [0062] Step 202: the system control center acquires the current geographical location of the user from the user location system B.

[0063] 用户定位系统基于卫星定位系统(GPS信号等)、无线通信网络、WiFi网络等其他技术确定用户当前所处的地理位置。 [0063] The positioning system determines the user is currently located based on user location techniques other satellite positioning system (GPS signal or the like), wireless communications networks, WiFi networks.

[0064] 步骤203 :系统控制中心将从出发地B至目的地A的路径请求发送给网络导航系统,并获取网络导航系统返回的最优路径PathBA。 [0064] Step 203: the system control center path B from the departure point to the destination network A sends a request to the navigation system, and obtain the optimal route navigation system returns PathBA network.

[0065] 网络导航系统能够基于出发地和目的地动态规划出路径,通常情况下网络导航系统会给出最优路径,或者,给出多条路径方案供用户选择,并显示用户选择的路径,在本实施例中以返回最优路径为例,本发明并不限制最优路径的具体规划方法。 [0065] Network-based navigation system capable of departure and destination points the dynamic programming path, the navigation system network normally gives the optimal path or multiple paths is given options for the user to select and display the route selected by the user, in the present embodiment, the optimal path to return to an example, the present invention is not limited to the specific optimal path planning method.

[0066] 步骤204 :系统控制中心将最优路径PathBA发送给用户界面控制系统进行显示。 [0066] Step 204: the system control center transmits the optimal path to the user interface control system PathBA displayed.

[0067] 步骤205 :系统控制中心从用户图像采集装置获取用户当前所处场景的实景图像 [0067] Step 205: the system control center acquires real image of the user from the user is currently located scene image capture device

Io Io

[0068]用户图像采集装置可以是用户移动设备端的图像采集传感器模块,用于采集用户所处的真实场景图像信息,采集的图像可以为单帧图像,也可以为视频图像。 [0068] The image acquisition device may be a user mobile device user terminal sensor image acquisition module for collecting the user information of the real scene image is located, the image captured may be a single image, the image may be a video. 例如用户不知道采用如何的行动方向来达到目的地时,可以通过诸如手机上的用户图像采集装置在当前朝向上拍摄一幅实景图像I,并发送给系统控制中心。 For example, when a user does not know how to use the direction of action to reach the destination, a real image I can be taken on by the current toward the image pickup device, such as a user on the phone, sent to the system control center. 该实景图像可以仅为2D的普通图像,不需要3D的街景图像。 The real image may be only ordinary 2D image, the 3D image does not need the street.

[0069] 步骤206 :系统控制中心从网络图像数据库中获取距离地理位置B在设定范围内的地理位置对应的图像,构成图像数据集U。 [0069] Step 206: obtain the geographic location system control center from the location B corresponding to the image within a set range from the image database in the network, constituting the image data set U.

[0070] 网络图像数据库中预先包含有大量街景图像以及各街景图像对应的地理属性,该地理属性就是街景图像中的地理位置信息和图像朝向信息。 [0070] The image database in advance network comprising a large number of images as well as Street Street geographic attributes corresponding to the image, the geographical location attribute information and the image is panoramic image orientation information. 本步骤的目的是找到地理位置B附近的街景图像。 Purpose of this step is to find the image near the street location B.

[0071] 另外,地理属性还包含街景图像中重要地理目标的属性信息,所谓重要地理目标可以包括但不限于:文字、路标、入口、出口等,属性信息可以是名称、用途或其他详细信息。 [0071] Further, geographic attributes further comprises attribute information important geographic target panoramic image, the so-called important geo targets may include, but are not limited to: text, signs, inlets, outlets and the like, the attribute information may be a name, purpose, or other details. 该部分将在步骤210中用到。 This portion will be used in step 210.

[0072] 另外,上述步骤205和步骤206没有固定的先后顺序,可以按照任意的顺序先后执行,也可以同时执行。 [0072] Further, the above-described steps 205 and 206 is not a fixed sequence, it can be performed in any desired order successively, or may be performed simultaneously.

[0073] 步骤207 :系统控制中心将实景图像I和图像数据集U发送给图像匹配系统,从图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像U0。 [0073] Step 207: the system control center real image I and the image data sets to the image matching system U, U acquires image data set with the highest degree of matching image I real image from image matching system U0.

[0074] 图像匹配系统在确定图像数据集U中与实景图像I匹配度最高的图像时,可以采用多种方式,主要可以分为两类:全局匹配方法和局部匹配方法。 When the image data set U with the highest real image I of the image matching [0074] In determining the image matching system, can be used in various ways, it can be divided into two categories: global and local matching matching method. 全局匹配方法可以采用计算图像的直方图向量,然后通过计算图像之间直方图向量的欧式距离的方法计算图像之间的匹配度,欧式距离越小,匹配度越高。 Histogram matching global vector calculation method may be employed in the image, the image matching degree between a histogram vector is then calculated by the method of the Euclidean distance between the images is calculated, the smaller Euclidean distance, the closer the match. 局部匹配方法可以提取图像的局部Sift特征,然后通过计算匹配成功的局部Sift特征个数来计算图像之间的匹配度,匹配成功的局部Sift特征个数越大,匹配度越高。 The larger the number of local feature Sift partial matching method may Sift extracts local features of an image, and then calculates the degree of match between the images by calculating the number of matching feature Sift partial success, successful matching, the closer the match.

[0075] 步骤208 :系统控制中心将图像UO的朝向信息作为实景图像I的朝向信息,利用该朝向信息、地理位置B和最优路径PathBA,确定用户的行动方向。 [0075] Step 208: the system control center UO information image orientation as the orientation information of a photographed image I using the orientation information, location B and the optimal path PathBA, determines the direction of the user's actions.

[0076] 图像UO是与实景图像I匹配度最高的图像,就可以近似认为图像UO的朝向就是实景图像I的朝向,由于图像UO是网络图像数据库中已知朝向信息的图像,因此就等同于得到了实景图像I的朝向信息。 [0076] UO image is an image with the highest degree of matching real image I, can be approximated that is facing toward the image of the real image I of UO, UO since the image is an image in the image database network known orientation information, and therefore equivalent to to give a real image I of orientation information.

[0077] 上述步骤206和步骤207实际上是确定实景图像I的朝向信息(即图像UO的朝向信息)的操作,这种方式不受制于特殊物理设备,同时与人视觉朝向更切合。 [0077] The above-described steps 206 and step 207 is actually the real image I of the orientation information (i.e. the image information toward the UO) operation is determined, this approach is not subject to particular physical equipment, and more realistic human visual orientation.

[0078] 实景图像I的朝向信息实际上是基于地理位置B的一个方向向量,而最优路径PathBA基于地理位置B也存在一个局部的方向向量,通过确定这两个方向向量的差异就能够得到用户的行动方向。 [0078] I photographed image orientation information is actually based on a direction vector location B, and the location-based optimal path PathBA B there is a local direction vector by determining the difference between the two direction vectors can be obtained action direction of the user. 如果两个方向向量一致,则说明用户拍摄的实景图像I的朝向信息与最优路径PathBA—致,则控制中心可以给出直行引导信号。 If the two vectors the same direction, then the real image of the user photographed I toward the optimal path information PathBA- actuator, the control center may be given straight pilot signal. 如果不一致,则利用方向向量的差异确定出用户转向正确方向的引导信号。 If not, the direction of the vector using the difference signal of the user is determined that the steering guide in the right direction.

[0079] 所谓方向向量一致与否可以采用计算两个方向向量之间相似度的方式,如果相似度在预设范围内,则认为两个方向向量一致,否则认为不一致。 [0079] The so-called in line vectors may be employed or not calculated degree of similarity between the two direction vectors manner within a preset range if the degree of similarity, the two same direction vectors that otherwise found to be inconsistent.

[0080] 步骤209 :系统控制中心将确定的行动方向、最优路径PathBA以及将图像UO的朝向信息作为实景图像I的朝向信息通过用户界面控制系统进行显示。 [0080] Step 209: the direction of action of the system control center will determine, PathBA optimal path and orientation information of the image as the orientation information UO real image I is displayed by a user interface control system.

[0081] 本发明并不限于行动方向采用的具体形式,可以采用例如箭头指向、重点标识等任意提供引导作用的形式。 [0081] The present invention is not limited to the specific forms of action employed, such as an arrow pointing key identification of any other action to provide guidance forms. 行动方向可以叠加展示在实景图像I上,也展示在行动路径PathBA的展示界面上。 Display of action can be superimposed on the real image I, also demonstrated in action path PathBA display interface. 实景图像I的朝向信息可以展示在行动路径PathBA的展示界面上。 Orientation information real image I may appear on the display screen PathBA action path.

[0082] 步骤210 :系统控制中心将图像UO中的重要地理目标匹配到图像I中的对应区域,并将对应区域的位置发送给用户界面控制系统进行展示。 [0082] Step 210: the system control center UO important images in a geographic target area is matched to the corresponding image I, and the corresponding user interface on display control system sent to the location area.

[0083] 为了方便用户找到对应的参照物,最好体现出图像I中的重要地理目标,本步骤中采用的方式是将图像UO中的重要地理目标匹配到图像I中的对应区域,匹配的方式可以采用图像查找技术,例如分别提取图像UO中重要地理目标的局部Sift特征以及图像I中的局部Sift特征,基于局部Sift特征的相似度将图像UO中重要地理目标的局部Sift特征向图像I投影,如果重要地理目标的局部Sift特征投影到图像I中的位置比较集中,也就是说,重要地理目标的局部Sift特征投影到图像I中的位置方差小于或等于预设的方差阈值,则投影位置的期望就是重要地理目标在图像I中的对应区域的位置,如果重要地理目标的特征投影到图像I中的位置比较分散,即重要地理目标的Sift特征投影到图像I中的位置方差大于预设的方差阈值,则认为没有在图像I中查找到重要地理目标的对应区 [0083] In order to facilitate the user to find the corresponding reference, the best embodiment of the geographical important target image I, step employed in the present embodiment is UO important images in a geographic target area is matched to a corresponding image I, matching image search techniques may employ, for example, were extracted partial image UO Sift important feature of the target and the local geographic feature Sift image I, based on the similarity of the feature local Sift Sift partial image UO important feature to a geographic target image I projection, an important feature if the local geographic Sift target image I projected into a position more concentrated, i.e., local geographic Sift important feature is projected onto a target position variance threshold variance image I is less than or equal to a preset, the projection a desired position is the position of the important geo target image I corresponding area, if a feature important geographic target projected image I position scattered, i.e. significant geographic target Sift features projected to a position variance of the image I is greater than a predetermined variance threshold set, it is important to find that there is no geographic target area corresponding to the image I . 上述图像的局部特征以Sift特征为例,还可以采用其他形式的图像局部特征。 Local features of the image features to Sift example, other forms of local image features may also be employed. 当然也可以采用其他图像查找技术。 Of course, other image search technology can also be used.

[0084] 另外,还可以进一步将重要地理目标的属性信息发送给用户界面控制系统进行展示,例如交通红绿灯的名字或用途等。 [0084] In addition, it can also send a further important geographic target attribute information to the user interface control system for display, such as traffic lights and other names or use.

[0085] 需要说明的是,步骤204、步骤209在上述实施例中的顺序并不固定,可以最终将最优路径、实景图像I的朝向信息、行动方向和重要地理目标信息中的至少一种同时通过用户界面控制系统进行显示。 [0085] Incidentally, steps 204, 209 in the order of the steps of the above-described embodiment is not fixed, at least one may ultimately optimal path toward the image I real information, a geographic target of action and important information simultaneously displayed by the user interface control system. 在显示时,可以显示在同一界面上,也可以显示在不同界面上通过切换界面的方式显示最优路径、实景图像I的朝向信息、行动方向或重要地理目标信肩、O In the display, may be displayed on the same screen, the display orientation may be optimal path information, real image I, the target of action or significant geographical shoulder through channel interface switching on different interfaces, O

[0086] 下面举一个实例,假设用户站在图3中会议厅中的位置B,欲前往目的地A,但用户并不知道自己当前面朝那个方向,也不知道如何能够到达目的地,此时用户通过用户界面控制系统输入了目的地A的信息,系统控制中心从用户定位系统获取到用户当前所处的地理位置B,系统控制中心将出发地至目的地A的路径请求发送给网络导航系统后,获取到网络导航系统返回的最优路径PathBA,并发送给用户界面控制系统进行显示,如图4中加粗虚线所示。 [0086] Here is an example, assume that the user is standing position B in Figure 3 in the conference hall, heading for destination A, but users do not know that they currently face in that direction, does not know how to reach the destination, this a user of the destination information input through the user interface of the control system, the system control center to obtain, from the positioning system user's current geographic location B, the system control center to the point of departure a to the destination of the navigation route request sent to the network after the system, the optimal path to obtain the navigation system returns PathBA network, sent to the user interface control system for display, as shown in bold broken line.

[0087] 然后用户在当前朝向上拍摄实景图像I,假设用户拍摄的实景图像I如图5所示(需要说明的是,为了满足专利申请文件的附图格式要求,在此采用逻辑示意图,在实际情况中则是用户实际拍摄的图像),其实际朝向在图4中如箭头所示,并将图像I发送给系统控制中心,系统控制中心从网络图像数据库中获取距离地理位置B在设定范围内的地理位置对应的图像数据,构成图像数据集U,然后将实景图像I和图像数据集U发送给图像匹配系统,由图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像U0,假设匹配到的图像UO如图6所示,同样此处采用的是逻辑示意图,在实际情况中是网络图像数据库中存储的图像。 [0087] The user then captured real image I on the current direction, assuming that the user captured real image I shown in FIG. (Note 5, in order to meet the requirements of the patent application format of the drawings, the use of this diagram, in in reality it is actually captured image of the user), the actual direction as indicated by arrow in FIG. 4, and transmits the image I to the system control center, location system control center acquires the distance B from the network setting in the image database location corresponding to the image data in the range, the image data constituting the set U, then the real image I and the image data sets to the image matching system U, U acquires image data set with the highest matching degree from the image I real image matching system image U0, assuming matched to UO image shown in FIG. 6, the same schematic is employed herein, a network is an image stored in the image database in reality.

[0088] 由于图像UO在网络图像数据库中存在朝向信息,系统控制中心将该朝向信息、地理位置B和最优路径PathBA结合起来确定用户的行动方向。 [0088] Since the information image orientation UO image database exists in the network, the system control center orientation information, and location B PathBA combine optimal path of action of the user is determined. 具体计算图像I的朝向信息基于地理位置B的方向向量与最优路径PathBA基于地理位置B的方向向量之间的相似度,如果相似度在预设的范围内,则认为两个方向向量一致,给出直行引导信号,否则认为不一致,根据两个方向向量的差异给出用户转向正确方向的引导信号。 DETAILED orientation information calculated based on the direction vector of the image I and location B, PathBA optimal path based on the similarity between the direction of the vector location of B, if the similarity is within a predetermined range, the same two directions that vectors, straight pilot signal is given, otherwise found to be inconsistent, the user is given the pilot signal in accordance with the steering direction is the right direction of the vector difference between the two. 然后,系统控制中心将确定的行动方向通过用户界面控制系统在图像I中进行显示。 Then, the system control center to determine the direction of operations performed in the image I displayed by a user interface control system. 假设在图像I中给出的行动方向如图7中箭头所示。 Suppose the direction of action of the image I is given in an arrow shown in FIG. 7.

[0089] 假设用户按照图7示出的行动方向左转90度之后,再次拍摄实景图像I,如图8所示,然后再次执行上述流程后,给出的行动方向如图9中黑色箭头所示。 After the direction of action [0089] Assume that the user shown in FIG 7 90 degrees left, again captured real image I, as shown in Figure 8 and perform the process again, given the direction of action of the black arrow in FIG. 9 shows. 更进一步地,系统控制中心将在此执行上述流程的图像UO中的重要地理目标(假设图像UO中的重要地理目标为门El)匹配到图像I中的对应区域,将该对应区域的位置发送给用户界面控制系统在图像I上进行显示如图10所示。 Still further, the system control center will perform important UO geographic target image in the above-described process herein (UO assumed that the image is an important target for the door geographical El) matched to the corresponding region of image I, and transmits the position corresponding to the region control system to the user interface displayed on the image I in FIG. 10.

[0090] 以上是对本发明所提供的实景导航方法进行的描述,下面通过实施例二对实景导航装置进行描述,该实景导航装置设置在上述的系统控制中心中。 [0090] The above is a description of the real navigation method provided by the present invention, the following embodiments will be described by two pairs of real navigation device according to the above-described real navigation device provided in the system control center.

[0091] 实施例二、 [0091] Example II.

[0092] 图11为本发明实施例二提供的实景导航装置的结构图,如图11所示,该装置可以包括:实景图像获取单元1101、网络图像获取单元1102、匹配图像获取单元1103和行动方向确定单元1104。 [0092] FIG 11 FIG real configuration of the navigation device according to a second embodiment of the invention, shown in Figure 11, the apparatus may comprise: a photographed image acquisition unit 1101, a network image acquisition unit 1102, obtaining unit 1103 and the image matching operations direction determination unit 1104.

[0093] 实景图像获取单元1101,用于从用户图像采集装置获取用户当前所处场景的实景图像I。 [0093] The photographed image acquisition unit 1101, configured to obtain the user from the user image capture device is currently located in the real scene image I. 其中实景图像I为用户所处的真实场景图像信息,采集的图像可以为单帧图像,也可以为视频图像。 Wherein I is the real image of the real scene image information of the user is located, the image captured may be a single image, the image may be a video.

[0094] 网络图像获取单元1102,用于从网络图像数据库中获取距离用户当前所处地理位置B在预设范围内的地理位置所对应的图像,构成图像数据集U。 [0094] Network image acquiring unit 1102, configured to obtain the image from a network database from the user's current geographic location B location within the image corresponding to the predetermined range, the image data set constituting the U. 网络图像数据库中预先包含有大量街景图像以及各街景图像对应的地理属性,该地理属性就是街景图像中的地理位置信息和图像朝向信息。 Image database in advance network comprising a large number of images as well as Street Street geographic attributes corresponding to the image, the geographical location attribute information and the image is panoramic image orientation information. 另外,地理属性还包含街景图像中重要地理目标的属性信息,所谓重要地理目标可以包括但不限于:文字、路标、入口、出口等,属性信息可以是名称、用途或其他详细信息。 Further, geographic attributes further comprises a geographic target attribute information of important panoramic image, a so-called geographic important targets may include, but are not limited to: text, signs, inlets, outlets and the like, the attribute information may be a name, purpose, or other details.

[0095] 匹配图像获取单元1103,用于将实景图像I和图像数据集U发送给图像匹配系统,并从图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像U0。 [0095] The image acquiring unit 1103 matches, for real image I and the image data sets to the image matching system U, U, and acquires image data set with the highest degree of matching image I real image from image matching system U0.

[0096] 行动方向确定单元1104,用于确定网络图像数据库中图像UO的朝向信息,利用该朝向信息、地理位置B以及从用户当前所处地理位置B到目的地A的行动路径,确定用户的行动方向。 [0096] mobile direction determination unit 1104 for determining a network UO image database the image orientation information, by using the orientation information from the user's current location B and route B to the geographical location of the destination mobile A, the user is determined of action.

[0097] 另外,该装置还包括:界面交互单元1105,用于将上述行动路径、行动方向以及将图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统进行展示,其中行动方向展示在实景图像I上;或者,将图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统,用于展示在行动路径的展示界面上;或者,将行动方向发送给用户界面控制系统,用于展示在的行动路径的展示界面上。 [0097] Further, the apparatus further comprising: interactive interface unit 1105, configured to send the information of the action toward the path of action and the real image as the image I UO orientation information to a user interface control display system in which the direction of action show on real image I; Alternatively, the image orientation information as a real image I UO orientation information sent to the user interface control system, an interface for displaying on a display of the path of action; or sends to the user interface control of action system for display on the display screen in the path of action.

[0098] 其中,从用户当前所处地理位置B到目的地A的行动路径需要该装置中的以下单元实现: [0098] where the user is currently located from the location A to the destination B path requires the action of the means to achieve the following units:

[0099] 界面交互单元1105接收来自用户界面控制系统的实景导航请求,该实景导航请求中包含目的地A的信息。 [0099] interactive interface unit 1105 receives a request from the user interface photo navigation control system, the destination information A real navigation comprises request.

[0100] 位置获取单元1106从用户定位系统获取用户当前所处的地理位置B。 [0100] geographic position acquisition unit 1106 acquires the user is currently located from a positioning system user B.

[0101] 路径获取单元1107将从出发地B至目的地A的路径请求发送给网络导航系统,并获取网络导航系统返回的行动路径。 Path [0101] acquiring unit 1107 path B from the departure point to the destination network A sends a request to the navigation system and the navigation system acquires action return path network.

[0102] 上述的行动路径是网络导航系统基于出发地和目的地动态规划出的路径,通常情况下导航系统会给出最优路径,或者,给出多条路径方案供用户选择,并展示用户选择的路径。 [0102] The course of action is a network navigation system, the origin and destination of the route based on dynamic programming, the navigation system will normally be given the optimal path, or, given a number of options for users to choose the path and show the user select path.

[0103] 图像UO是与实景图像I匹配度最高的图像,就可以近似认为图像UO的朝向就是实景图像I的朝向,由于图像UO是网络图像数据库中已知朝向信息的图像,因此就等同于得到了实景图像I的朝向信息。 [0103] UO image is an image with the highest degree of matching real image I, can be approximated that is facing toward the image of the real image I of UO, UO since the image is an image in the image database network known orientation information, and therefore equivalent to to give a real image I of orientation information. 上述的朝向信息为基于地理位置B的方向向量,行动方向确定单元1104确定行动路径基于地理位置B的方向向量,通过确定这两个方向向量的差异得到用户的行动方向。 The above-described orientation information determining unit 1104 determines a path of action based on a direction vector location B by determining the difference between the two directions of action vectors give the user the direction vector based on the location of action of B.

[0104] 例如,如果两个方向向量一致,则说明用户拍摄的实景图像I的朝向信息与行动路径一致,则控制中心可以给出直行引导信号。 [0104] For example, if two vectors the same direction, then the real image of the user captured with I action toward the same route information, the control center may be given straight pilot signal. 如果不一致,则利用方向向量的差异确定出用户转向正确方向的引导信号。 If not, the direction of the vector using the difference signal of the user is determined that the steering guide in the right direction. 所谓方向向量一致与否可以采用计算两个方向向量之间相似度的方式,如果相似度在预设范围内,则认为两个方向向量一致,否则认为不一致。 The so-called vector of the same direction or not calculated degree of similarity between two vectors may employ directions, within a preset range if the degree of similarity, the two same direction vectors that otherwise found to be inconsistent.

[0105] 更进一步地,为了方便用户找到对应的参照物,该装置还可以包括: [0105] Still further, in order to facilitate the user to find the corresponding reference, the apparatus may further comprise:

[0106] 目标匹配单元1108,用于将图像UO中的重要地理目标匹配到图像I中的对应区域。 [0106] target matching unit 1108, configured to image the important target UO is matched to a corresponding geographical area image I. 具体可以基于局部特征的相似度,将图像UO中重要地理目标的局部特征向图像I投影,如果投影位置的方差小于或等于预设的方差阈值,则将投影位置的期望确定为图像UO中的重要地理目标在图像I中的对应区域的位置。 Similarity can be based on the specific local features, local feature image UO important to a geographic target image I projected, the projection position if the variance is less than or equal to a preset threshold variance value, then the desired position is determined as the projection of the image UO the important geographical position in the target image I corresponding area. 其中上述的局部特征可以采用Sift特征。 Wherein said local features may be employed Sift features.

[0107] 界面交互单元1105将对应区域的位置发送给用户界面控制系统进行展示。 [0107] The interactive interface unit 1105 transmits a position corresponding to the region control system user interface display. 除此之外,还可以将重要地理目标的属性信息发送给用户界面控制系统进行展示,例如交通红绿灯的名字或用途等。 In addition, properties can also be important geographic target information sent to the user interface control system for display, such as traffic lights and other names or use.

[0108] 由以上描述可以看出,本发明提供的方法和装置具备以下优点: [0108] As can be seen from the above description, the present invention provides a method and apparatus includes the following advantages:

[0109] I)用户仅需要将当前所处场景的实景图像进行上传变可以获知行动方向,无需用户依据地图中的路线额外进行方向判别,对于方向感较差的用户而言,显然十分简单方便。 [0109] I) the user only needs to which the real image of the current scene change can upload informed of action, without the user direction determination based on the additional route map, a poor sense of direction for the user, is obviously very simple and convenient .

[0110] 2)本发明中用户通过移动端上传和接收的图像均为2D的实景图像,而不必是3D街景图像,显然大大减少了移动端的数据量传输。 [0110] 2) and received by the mobile user terminal to upload the present invention, the 2D images are real images, but not necessarily 3D panoramic image, apparently greatly reduced the amount of data transmission to the mobile terminal.

[0111] 3)本发明不但适用于大范围、长距离的路线规划,同样适用于小范围的地域中,对于诸如商场、办公楼、酒店、会议中心等建筑物内部的实景导航同样可以应用。 [0111] 3) The present invention is applicable not only to large-scale, long-distance route planning, is equally applicable to small geographic range, such as for real navigation inside shopping malls, office buildings, hotels, conference centers and other buildings can also be applied.

[0112] 以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明保护的范围之内。 [0112] The foregoing is only preferred embodiments of the present invention but are not intended to limit the present invention, all within the spirit and principle of the present invention, any changes made, equivalent substitutions and improvements should be included within the scope of protection of the present invention.

Claims (14)

1. 一种实景导航方法,其特征在于,该方法包括: 51、从用户图像采集装置获取用户当前所处场景的实景图像I ;以及,从网络图像数据库中获取距离用户当前所处地理位置B在预设范围内的地理位置所对应的图像,构成图像数据集U ; 52、将实景图像I和图像数据集U发送给图像匹配系统,并从图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像UO ; 53、确定网络图像数据库中图像UO的朝向信息,利用该朝向信息、地理位置B以及从用户当前所处地理位置B到目的地A的行动路径,确定用户的行动方向。 A real navigation method, characterized in that, the method comprising: 51 to acquire a photographed image I user from the user is currently located scene image capture device; and, obtaining the distance from the network user database of the current geographical location of the image B location within a preset range of the image corresponding to the image data constituting the set U; 52 is, the real image I and the image data sets to the image matching system U, U, and acquires image data set from the photographed image with the image matching system matching the highest image I UO; 53 is, determine the orientation of the image information of the image database UO network, with which the orientation information, from the user's current location B and route B to the geographical location of the destination mobile a is determined that the user's actions direction.
2.根据权利要求I所述的方法,其特征在于,该方法还包括: 将行动路径、行动方向以及将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统进行展示,其中所述行动方向展示在实景图像I上;或者, 将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统,用于展示在所述行动路径的展示界面上;或者, 将所述行动方向发送给用户界面控制系统,用于展示在所述的行动路径的展示界面上。 2. The method as claimed in claim I, wherein the method further comprises: the path towards the action information, and the image of action UO photographed image as the orientation information I sent to the user interface control system for display wherein the action direction of the image displayed on the real I; Alternatively, the image orientation information as transmission UO orientation information of the real image I to the user interface control system for display on the display screen of the path of action; Alternatively, the transmitting direction of the action to the user interface control system for display in the path of action of the presentation interface.
3.根据权利要求I所述的方法,其特征在于,该方法还包括: 接收来自用户界面控制系统的实景导航请求,该实景导航请求中包含目的地A的信息; 从用户定位系统获取用户当前所处的地理位置B ; 将从出发地B至目的地A的路径请求发送给网络导航系统,并获取网络导航系统返回的行动路径。 3. The method as claimed in claim I, wherein the method further comprises: receiving a request from the user interface photo navigation control system, the destination information A real navigation request comprising; obtain, from the user's current location system geographical location B; B path from the departure point to the destination network a sends a request to the navigation system and the navigation system acquires action return path network.
4.根据权利要求1、2或3所述的方法,其特征在于,所述行动路径为最优路径。 4. The method according to claim 2 or 3, wherein the optimal path is the path of action.
5.根据权利要求I所述的方法,其特征在于,在所述步骤S3中,所述朝向信息为基于地理位置B的方向向量,确定所述行动路径基于地理位置B的方向向量,通过确定这两个方向向量的差异得到用户的行动方向。 5. The method of claim I, wherein, in the step S3, the orientation information is the orientation vector based on the location B, to determine the action path based on the vector direction B of the geographic location by determining these two differences in direction of the vector direction of the user to get action.
6.根据权利要求I所述的方法,其特征在于,该方法还包括: 将图像UO中的重要地理目标匹配到图像I中的对应区域,并将对应区域的位置发送给用户界面控制系统进行展示。 6. The method of claim I, wherein the method further comprises: UO important pictures in the corresponding region is matched to a geographic target image I, and transmits a position corresponding to a region of the user interface control system show.
7.根据权利要求6所述的方法,其特征在于,所述将图像UO中的重要地理目标匹配到图像I中的对应区域具体包括: 基于局部特征的相似度,将图像UO中重要地理目标的局部特征向图像I投影,如果投影位置的方差小于或等于预设的方差阈值,则将投影位置的期望确定为图像UO中的重要地理目标在图像I中的对应区域的位置。 7. The method according to claim 6, characterized in that the important images in a geographic target UO matched to the corresponding region of image I comprises: similarity-based local features, the geographic target image important UO local features of the image I projected, the projection position if the variance is less than or equal to a preset threshold variance value, then a desired projected position as a position UO important geo-target image in the image I corresponding area.
8. 一种实景导航装置,其特征在于,该装置包括: 实景图像获取单元,用于从用户图像采集装置获取用户当前所处场景的实景图像I ;网络图像获取单元,用于从网络图像数据库中获取距离用户当前所处地理位置B在预设范围内的地理位置所对应的图像,构成图像数据集U ; 匹配图像获取单元,用于将实景图像I和图像数据集U发送给图像匹配系统,并从图像匹配系统获取图像数据集U中与实景图像I匹配度最高的图像UO ;行动方向确定单元,用于确定网络图像数据库中图像UO的朝向信息,利用该朝向信息、地理位置B以及从用户当前所处地理位置B到目的地A的行动路径,确定用户的行动方向。 A real navigation device, wherein, the apparatus comprising: a photographed image acquisition unit for acquiring a user from a user image capture device is currently located in the real scene image I; image acquisition unit network, from the network to the image database obtaining from the user's current geographic location B location within the image corresponding to the predetermined range, the image data constituting the set U; matching image acquisition unit for the real image I and the image data sets to the image matching system U and image matching system acquire image data sets with the highest U real image I of the image matching from UO; action direction determining means for determining the orientation information of the image database the image UO network, with which the orientation information, and location B from the user's current geographical location to the destination mobile path a, B, determines the direction of the user's actions.
9.根据权利要求8所述的装置,其特征在于,该装置还包括: 界面交互单元,用于将所述行动路径、行动方向以及将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统进行展示,其中所述行动方向展示在实景图像I上;或者, 将所述图像UO的朝向信息作为实景图像I的朝向信息发送给用户界面控制系统,用于展示在所述行动路径的展示界面上;或者, 将所述行动方向发送给用户界面控制系统,用于展示在所述的行动路径的展示界面上。 9. The apparatus according to claim 8, wherein the apparatus further comprises: an interface interacting unit, configured to act toward the path information, and the image of action UO as the orientation information of the real image I sent to the user interface control system for display, wherein the operation direction displayed on the real image I; Alternatively, the image orientation information of the orientation information as UO real image I is transmitted to the user interface control system for display in the action path on said display screen; or the transmitting direction of action to the user interface control system for display on the display screen of the action path.
10.根据权利要求8所述的装置,其特征在于,该装置还包括: 界面交互单元,用于接收来自用户界面控制系统的实景导航请求,该实景导航请求中包含目的地A的信息; 位置获取单元,用于从用户定位系统获取用户当前所处的地理位置B ; 路径获取单元,用于将从出发地B至目的地A的路径请求发送给网络导航系统,并获取网络导航系统返回的行动路径。 10. The apparatus according to claim 8, wherein the apparatus further comprises: interactive interface unit to receive a request from the user interface photo navigation control system, the destination information A real navigation request comprising; position acquiring means for acquiring the current user B from the user's geographical location positioning system; route acquiring unit configured to route B from the departure point to the destination network a sends a request to the navigation system, a navigation system and acquire the network returns action path.
11.根据权利要求8、9或10所述的装置,其特征在于,所述行动路径为最优路径。 11. The apparatus of claim 8, 9 or claim 10, wherein the optimal path is the path of action.
12.根据权利要求8所述的装置,其特征在于,所述朝向信息为基于地理位置B的方向向量,所述行动方向确定单元确定所述行动路径基于地理位置B的方向向量,通过确定这两个方向向量的差异得到用户的行动方向。 12. The apparatus according to claim 8, wherein the orientation information is direction vector based on the location B, the mobile direction determination unit determines the location-based action path B direction vector, which is determined by the difference between the two direction vectors of action to get the user.
13.根据权利要求8所述的装置,其特征在于,该装置还包括: 目标匹配单元,用于将图像UO中的重要地理目标匹配到图像I中的对应区域; 界面交互单元,用于将所述对应区域的位置发送给用户界面控制系统进行展示。 13. The apparatus according to claim 8, wherein the apparatus further comprises: target matching unit, configured to image the important target UO is matched to a corresponding geographical area in the image I; interactive interface unit for corresponding to the position of the region is sent to the user interface control display system.
14.根据权利要求13所述的装置,其特征在于,所述目标匹配单元在执行所述匹配的操作时,具体基于局部特征的相似度,将图像UO中重要地理目标的局部特征向图像I投影,如果投影位置的方差小于或等于预设的方差阈值,则将投影位置的期望确定为图像UO中的重要地理目标在图像I中的对应区域的位置。 14. The apparatus according to claim 13, wherein the target matching unit, when performing the matching operation, in particular based on the similarity of local features, local feature image UO important to a geographic target image I projector, the projection position if the variance is less than or equal to a preset threshold variance value, then a desired projected position as a position UO important geo-target image in the image I corresponding area.
CN2012103093526A 2012-08-27 2012-08-27 Live action navigation method and live action navigation device CN102829788A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012103093526A CN102829788A (en) 2012-08-27 2012-08-27 Live action navigation method and live action navigation device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012103093526A CN102829788A (en) 2012-08-27 2012-08-27 Live action navigation method and live action navigation device

Publications (1)

Publication Number Publication Date
CN102829788A true CN102829788A (en) 2012-12-19

Family

ID=47333006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012103093526A CN102829788A (en) 2012-08-27 2012-08-27 Live action navigation method and live action navigation device

Country Status (1)

Country Link
CN (1) CN102829788A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103162693A (en) * 2013-03-12 2013-06-19 深圳市凯立德科技股份有限公司 Lane information display method and navigation device
CN103903253A (en) * 2012-12-28 2014-07-02 联想(北京)有限公司 Mobile terminal positioning method and system
WO2014176938A1 (en) * 2013-05-03 2014-11-06 Tencent Technology (Shenzhen) Company Limited Method and apparatus of retrieving information
CN104750448A (en) * 2015-03-23 2015-07-01 联想(北京)有限公司 Method for information processing, electronic equipment and wearable equipment
CN104990555A (en) * 2015-02-17 2015-10-21 上海安悦四维信息技术有限公司 Working method of real scene navigation system
CN105066999A (en) * 2015-07-06 2015-11-18 小米科技有限责任公司 Position information determination method and apparatus thereof
CN105222794A (en) * 2014-06-10 2016-01-06 联想(北京)有限公司 Information processing method and electronic equipment
CN105318881A (en) * 2014-07-07 2016-02-10 腾讯科技(深圳)有限公司 Map navigation method, and apparatus and system thereof
CN105321224A (en) * 2015-11-26 2016-02-10 杨荣庆 Mountaineering recording and time consumption statistic method
CN105371847A (en) * 2015-10-27 2016-03-02 深圳大学 Indoor live-action navigation method and system
CN106032990A (en) * 2015-03-21 2016-10-19 吴红平 Working method of real scene navigation system
CN106126593A (en) * 2016-06-20 2016-11-16 国家基础地理信息中心 Earth's surface based on network opening photo resources outdoor scene information generating method and device
CN106651525A (en) * 2016-12-28 2017-05-10 苏州商信宝信息科技有限公司 Method and system for enhancement of real position guide based on e-commerce platform
CN106969774A (en) * 2013-04-28 2017-07-21 腾讯科技(深圳)有限公司 Air navigation aid and device, terminal, server and system
CN107036609A (en) * 2016-10-18 2017-08-11 中建八局第建设有限公司 Virtual reality air navigation aid, server, terminal and system based on BIM
CN107356262A (en) * 2017-07-11 2017-11-17 上海共佰克智能科技有限公司 Correct the method for navigation direction and the device of amendment navigation direction
CN108303972A (en) * 2017-10-31 2018-07-20 腾讯科技(深圳)有限公司 The exchange method and device of mobile robot

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11211499A (en) * 1998-01-26 1999-08-06 Nissan Motor Co Ltd Information presenting system
CN1869593A (en) * 2005-05-26 2006-11-29 乐金电子(中国)研究开发中心有限公司 Mobile communication terminal possessing geography information providing function and method thereof
CN1880918A (en) * 2005-06-14 2006-12-20 Lg电子株式会社 Matching camera-photographed image with map data in portable terminal and travel route guidance method
CN1908583A (en) * 2006-08-18 2007-02-07 清华大学 Fast view matching method based on convolution
CN101046387A (en) * 2006-08-07 2007-10-03 南京航空航天大学 Scene matching method for raising navigation precision and simulating combined navigation system
CN101097150A (en) * 2006-06-28 2008-01-02 北京华旗资讯数码科技有限公司;上海爱国者数码科技有限公司 Navigation method used for navigation in small region
CN101194143A (en) * 2005-06-06 2008-06-04 通腾科技股份有限公司 Navigation device with camera information
CN101275854A (en) * 2007-03-26 2008-10-01 日电(中国)有限公司 Method and equipment for updating map data
CN101451852A (en) * 2008-12-19 2009-06-10 深圳华为通信技术有限公司 Navigation equipment and navigation method
CN101592494A (en) * 2008-05-27 2009-12-02 三星电子株式会社 Apparatus providing search service, method and program thereof
CN102208012A (en) * 2010-03-31 2011-10-05 爱信艾达株式会社 Scene matching reference data generation system and position measurement system
CN102207389A (en) * 2010-03-31 2011-10-05 爱信艾达株式会社 The vehicle position recognition system

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11211499A (en) * 1998-01-26 1999-08-06 Nissan Motor Co Ltd Information presenting system
CN1869593A (en) * 2005-05-26 2006-11-29 乐金电子(中国)研究开发中心有限公司 Mobile communication terminal possessing geography information providing function and method thereof
CN101194143A (en) * 2005-06-06 2008-06-04 通腾科技股份有限公司 Navigation device with camera information
CN1880918A (en) * 2005-06-14 2006-12-20 Lg电子株式会社 Matching camera-photographed image with map data in portable terminal and travel route guidance method
CN101097150A (en) * 2006-06-28 2008-01-02 北京华旗资讯数码科技有限公司;上海爱国者数码科技有限公司 Navigation method used for navigation in small region
CN101046387A (en) * 2006-08-07 2007-10-03 南京航空航天大学 Scene matching method for raising navigation precision and simulating combined navigation system
CN1908583A (en) * 2006-08-18 2007-02-07 清华大学 Fast view matching method based on convolution
CN101275854A (en) * 2007-03-26 2008-10-01 日电(中国)有限公司 Method and equipment for updating map data
CN101592494A (en) * 2008-05-27 2009-12-02 三星电子株式会社 Apparatus providing search service, method and program thereof
CN101451852A (en) * 2008-12-19 2009-06-10 深圳华为通信技术有限公司 Navigation equipment and navigation method
CN102208012A (en) * 2010-03-31 2011-10-05 爱信艾达株式会社 Scene matching reference data generation system and position measurement system
CN102207389A (en) * 2010-03-31 2011-10-05 爱信艾达株式会社 The vehicle position recognition system

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103903253B (en) * 2012-12-28 2017-06-27 联想(北京)有限公司 A kind of movable termination localization method and system
CN103903253A (en) * 2012-12-28 2014-07-02 联想(北京)有限公司 Mobile terminal positioning method and system
CN103162693A (en) * 2013-03-12 2013-06-19 深圳市凯立德科技股份有限公司 Lane information display method and navigation device
CN106969774A (en) * 2013-04-28 2017-07-21 腾讯科技(深圳)有限公司 Air navigation aid and device, terminal, server and system
WO2014176938A1 (en) * 2013-05-03 2014-11-06 Tencent Technology (Shenzhen) Company Limited Method and apparatus of retrieving information
CN105222794A (en) * 2014-06-10 2016-01-06 联想(北京)有限公司 Information processing method and electronic equipment
CN105318881A (en) * 2014-07-07 2016-02-10 腾讯科技(深圳)有限公司 Map navigation method, and apparatus and system thereof
CN104990555B (en) * 2015-02-17 2018-07-03 上海安吉四维信息技术有限公司 The method of work of real scene navigation system
CN104990555A (en) * 2015-02-17 2015-10-21 上海安悦四维信息技术有限公司 Working method of real scene navigation system
CN106032990B (en) * 2015-03-21 2019-01-08 吴红平 The working method of real scene navigation system
CN106032990A (en) * 2015-03-21 2016-10-19 吴红平 Working method of real scene navigation system
CN104750448A (en) * 2015-03-23 2015-07-01 联想(北京)有限公司 Method for information processing, electronic equipment and wearable equipment
CN105066999A (en) * 2015-07-06 2015-11-18 小米科技有限责任公司 Position information determination method and apparatus thereof
CN105371847B (en) * 2015-10-27 2018-06-29 深圳大学 A kind of interior real scene navigation method and system
CN105371847A (en) * 2015-10-27 2016-03-02 深圳大学 Indoor live-action navigation method and system
CN105321224A (en) * 2015-11-26 2016-02-10 杨荣庆 Mountaineering recording and time consumption statistic method
CN106126593A (en) * 2016-06-20 2016-11-16 国家基础地理信息中心 Earth's surface based on network opening photo resources outdoor scene information generating method and device
CN106126593B (en) * 2016-06-20 2019-05-21 国家基础地理信息中心 Earth's surface outdoor scene information generating method and device based on network opening photo resources
CN107036609A (en) * 2016-10-18 2017-08-11 中建八局第建设有限公司 Virtual reality air navigation aid, server, terminal and system based on BIM
CN106651525A (en) * 2016-12-28 2017-05-10 苏州商信宝信息科技有限公司 Method and system for enhancement of real position guide based on e-commerce platform
CN107356262A (en) * 2017-07-11 2017-11-17 上海共佰克智能科技有限公司 Correct the method for navigation direction and the device of amendment navigation direction
CN108303972A (en) * 2017-10-31 2018-07-20 腾讯科技(深圳)有限公司 The exchange method and device of mobile robot

Similar Documents

Publication Publication Date Title
US8264584B2 (en) Image capturing apparatus, additional information providing server, and additional information filtering system
US9582166B2 (en) Method and apparatus for rendering user interface for location-based service having main view portion and preview portion
US9342927B2 (en) Augmented reality system for position identification
CN102985901B (en) Used on mobile devices is based on a method and apparatus of FIG service perspective rendering position of the object and its associated content
EP1246080B1 (en) Automated annotation of a view
US8213749B2 (en) System and method for creating, storing and utilizing images of a geographic location
US20120013609A1 (en) Method and apparatus for presenting a first person world view of content
US6222583B1 (en) Device and system for labeling sight images
JP5871976B2 (en) Mobile imaging device as navigator
JP5582548B2 (en) Display method of virtual information in real environment image
US9915544B2 (en) Method and apparatus for providing service using a sensor and image recognition in a portable terminal
US8543917B2 (en) Method and apparatus for presenting a first-person world view of content
JP2015084229A (en) Camera pose determination method and actual environment object recognition method
US8036678B2 (en) Real-time geographic information system and method
CN101924992B (en) Method, system and equipment for acquiring scene information through mobile terminal
US8331611B2 (en) Overlay information over video
US20020045988A1 (en) Spatial information using system, system for obtaining information, and server system
JP2006105640A (en) Navigation system
KR101260576B1 (en) User Equipment and Method for providing AR service
US10134196B2 (en) Mobile augmented reality system
CN101769747B (en) Intelligent tour conducting system and method for scenery spots
US20070070069A1 (en) System and method for enhanced situation awareness and visualization of environments
CN103398717B (en) Panoramic map database collection system and visual positioning, navigation based on
CN102204238B (en) Image annotation on portable devices
CN104457704B (en) UAV ground-based targeting system and method for enhancing geographic information

Legal Events

Date Code Title Description
C06 Publication
EXSB Decision made by sipo to initiate substantive examination
RJ01