CN102194007A - System and method for acquiring mobile augmented reality information - Google Patents

System and method for acquiring mobile augmented reality information Download PDF

Info

Publication number
CN102194007A
CN102194007A CN2011101440147A CN201110144014A CN102194007A CN 102194007 A CN102194007 A CN 102194007A CN 2011101440147 A CN2011101440147 A CN 2011101440147A CN 201110144014 A CN201110144014 A CN 201110144014A CN 102194007 A CN102194007 A CN 102194007A
Authority
CN
China
Prior art keywords
information
platform
image
unit
request
Prior art date
Application number
CN2011101440147A
Other languages
Chinese (zh)
Other versions
CN102194007B (en
Inventor
梁宇杰
杨杰
李锭伟
Original Assignee
中国电信股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国电信股份有限公司 filed Critical 中国电信股份有限公司
Priority to CN201110144014.7A priority Critical patent/CN102194007B/en
Publication of CN102194007A publication Critical patent/CN102194007A/en
Application granted granted Critical
Publication of CN102194007B publication Critical patent/CN102194007B/en

Links

Abstract

The invention provides a system and a method for acquiring mobile augmented reality information. The method comprises the following steps of: acquiring image information, and extracting image characteristics of the image information; determining an information platform needed to establish connection, and connecting one or a plurality of information platforms according to an information platform address; carrying the image characteristics and position information in a request parameter, and transmitting the request parameter to the information platform; and searching through the information platform according to the request parameter so as to acquire content information matched with the request parameter, and returning the content information to an augmented reality service processing platform. By the method, the acquisition accuracy of the information is improved, and the information can be accurately matched and superposed with realistic scenes.

Description

获取移动增强现实信息的系统和方法 Get mobile augmented reality information system and method

技术领域 FIELD

[0001] 本发明涉及移动通信增值业务领域,尤其涉及获取移动增强现实信息的系统和方法。 [0001] The present invention relates to a mobile communication value-added services, and in particular relates to systems and method for acquiring mobile augmented reality information.

背景技术 Background technique

[0002] 目前有一类基于移动终端的增强现实应用,终端获取所处位置的位置信息,然后业务处理平台进行处理及搜索,返回信息点的资讯信息,并在终端上将信息点和终端镜头拍摄的实景进行融合展现。 [0002] There are a class of augmented reality applications based on the mobile terminal, the terminal location acquiring location information, and business processing platform for processing and search, return information information point and shooting information on the terminal and the terminal point of the lens the real fusion show. 该应用当用户用手机摄像头对准目标,屏幕上就可以看到叠加在实景影像上的相关文字提示或虚拟影像、标签,获取各种相关资讯、点评,省去用户进行输入搜索的麻烦,提供新的体验。 The application when the user at the target using a mobile phone camera, you can see on the screen superimposed on the real image or a virtual image associated text prompts, labels, access to all relevant information, comments, eliminating the need for users to enter a search of trouble, provided New experience.

[0003] 目前此类应用在架构上,已有业务处理平台和资讯平台分离的处理方案,业务处理平台通过发送请求到资讯平台,获取资讯内容,现有方案中业务平台和资讯平台交互请求的参数仅限于位置经纬度,定位结果的误差造成获取的资讯信息较多,精准度不够,业务处理平台可能难以获取到所需镜头拍摄的实景准确管理信息,并与现实场景的图像进行匹配叠加,或者虚拟信息叠加的效果较差,影响用户体验。 [0003] At present such applications in architecture, there are business processing platform and information platform separate processing solutions, business process platform by sending a request to the information platform, access to information content, existing programs in business and information platform interactive platform request parameters only latitude and longitude position, the positioning errors caused by the results get more news and information, the accuracy is not enough, business processing platform may be difficult to get into live action shots required accurate management information, and superimposed with the image of a real scene matching, or poor virtual information superimposed effect, affecting the user experience.

发明内容 SUMMARY

[0004] 鉴于以上,本发明的目的是提出获取移动增强现实信息的系统和方法。 [0004] In view of the foregoing, an object of the present invention is to propose a system and method for acquiring mobile augmented reality information.

[0005] 根据本发明一方面,提出获取移动增强现实信息的系统,其中: [0005] According to an aspect of the present invention there is provided a mobile AR information acquisition system, wherein:

[0006] 增强现实业务处理平台包括: [0006] Augmented Reality business processing platform include:

[0007] 位置获取单元,用于获取所处地点的位置信息,将位置信息传送给控制单元; [0007] The position obtaining unit configured to obtain location information of the location in which the transmitting location information to the control unit;

[0008] 图像获取单元,用于获取图像信息,将图像信息传送给图像分析单元; [0008] The image acquiring unit for acquiring image information, transmitting the image information to the image analysis unit;

[0009] 图像分析单元,用于对图像获取单元获取的图像信息进行特征分析,提取图像特征,将图像特征传送给控制单元; [0009] The image analysis unit for the image information acquiring unit acquiring image feature analysis, image feature extraction, feature transfers the image to the control unit;

[0010] 控制单元分别与位置获取单元、方向获取单元、图像获取单元、图像分析单元连接,用于将图像特征和位置信息携带在请求参数中,以及确定请求参数要发往的资讯平台; [0010] each control unit position acquisition unit, a direction acquiring unit, an image acquisition unit, an image analysis unit connected to the image feature and the position information carried in the request parameters, the request parameters and determining information to be sent to the internet;

[0011] 资讯平台管理单元,用于管理资讯平台的信息,包括资讯平台信息库,每个资讯平台都在该信息库中有对应的记录; [0011] The information platform management unit for managing information of the information platform, the platform including information repository, each platform has the corresponding information recorded in the information repository;

[0012] 资讯平台接口单元,用于和各个资讯平台连接通信,根据接口协议向资讯平台发送请求参数并获取反馈的内容资讯; [0012] Information internet interface unit, and for each communication connection information platform, internet information transmission request parameters to acquire the content in accordance with the interface protocol and of the feedback information;

[0013] 资讯平台包括: [0013] information platform include:

[0014] 接口单元,具有连接地址,用于和增强现实业务处理平台连接通信,获取请求参数并反馈内容资讯; [0014] The interface unit has a connection address, and augmented reality service for connecting a communication processing platform, and feeds back the content acquisition request parameter information;

[0015] 连接单元,分别与接口单元、内容管理单元连接,用于从接口单元获取请求参数, 从内容管理单元获取与请求参数匹配的内容资讯,将内容资讯传送给接口单元; [0015] connecting means, respectively, and the interface unit, connected to the content management unit, an interface unit acquires the request parameters, the request unit acquires content information matching parameter, the information to transmit content from the content management unit from the interface;

[0016] 内容管理单元,用于根据请求参数搜索到匹配的内容资讯并传送给连接单元。 [0016] The content management unit, according to a search request for content information to the matching parameter and transferred to the connection unit.

[0017] 根据本发明另一方面,还提出获取移动增强现实信息的方法,包括如下步骤: [0017] According to another aspect of the present invention further provides a method for acquiring movement information of the AR, comprising the steps of:

[0018] 增强现实业务处理平台获取图像信息,对图像信息提取图像特征; [0018] AR service platform acquires image information processing, image feature extraction of image information;

[0019] 增强现实业务处理平台确定要建立连接的资讯平台,根据资讯平台地址连接一个或多个资讯平台; [0019] Augmented Reality business processing platform determines to establish a connection information platform, connecting one or more address information platform based on the information platform;

[0020] 增强现实业务处理平台将图像特征和位置信息携带在请求参数中,将请求参数发到资讯平台; [0020] AR internet service processing image feature and the position information carried in the request parameters, the request to send the parameter information platform;

[0021] 资讯平台根据请求参数进行搜索,获取与请求参数匹配的内容资讯,返回给增强现实业务处理平台。 [0021] Information platform based on the search request parameters, obtain information and content matching the request parameters, return to the augmented reality business processing platform.

[0022] 根据本发明另一方面,还提出建立业务平台与资讯平台之间连接的接口,包括: [0022] According to another aspect of the present invention, also provides an interface to establish a connection between the service platform and the information platform, comprising:

[0023] 资讯平台接口单元,设置在业务平台,用于和各个资讯平台连接通信,根据接口协议向资讯平台发送请求参数并获取反馈的内容资讯,所述请求参数包括位置信息和图像特征; [0023] Information internet interface unit, provided at the service platform, and each of the information platform for the communication connection, internet information transmission request parameters to acquire the content in accordance with the interface protocol and feedback information, the request information includes a position parameter and the image feature;

[0024] 接口单元,设置在资讯平台,具有连接地址,用于和业务平台连接通信,获取请求参数并反馈与所述请求参数匹配的内容资讯。 [0024] The interface unit provided in the information platform, having a connection address, and the service platform for the communication connection, and an acquisition request feedback parameter of the requested content information matching parameter.

[0025] 本发明可根据接口参数,比如位置经纬度、摄像镜头方向、图像特征等获取内容资讯,通过多参数的搜索筛选,从资讯平台获取内容资讯,提高信息获取的准确性,实现与现实场景的精准匹配和叠加,优化用户的交互体验,可支持图像搜索等更多应用,支持的应用例如人脸搜索后提供个人空间的资讯访问、植物识别后提供植物资讯、车辆识别后提供车辆信息和优惠等信息。 [0025] According to the present invention can interface parameters, such as longitude and latitude, the direction of the imaging lens, wherein the image content information and the like acquired, by searching the multi-parameter screening, acquire the content information from the information platform, improve the accuracy of the acquired information, to realize real scene and the precise matching and overlay, optimize the user's interactive experience, can support more applications such as image search, support for applications such as providing personal space after the face search information access, providing plant after plant identification information, provide vehicle identification and vehicle information concessions and other information. 在这些应用中,业务平台进行初步的识别和结果展现,资讯平台根据接口获取需求后,进行专业的识别并提供匹配的资讯。 In these applications, the business platform for the identification and preliminary results show, according to the interface to obtain information platform needs, professional recognition and to provide matching information.

附图说明 BRIEF DESCRIPTION

[0026] 图1为本发明系统的结构示意图,其中图像分析单元设置在终端; [0026] Fig 1 a schematic structural diagram of the system of the present invention, wherein the image analysis unit provided in the terminal;

[0027] 图2为本发明系统的结构示意图,其中图像分析单元设置在业务平台; [0027] FIG. 2 is a schematic structural diagram of a system of the present invention, wherein the image analysis unit provided service platform;

[0028] 图3为本发明系统的结构示意图,其中图像分析单元设置在业务平台以及资讯平台; [0028] Fig 3 a schematic view of the structure of the system of the present invention, wherein the image analyzing unit as well as information provided internet service platform;

[0029] 图4为本发明方法的流程图。 [0029] FIG 4 is a flowchart of a method of the present invention.

具体实施方式 Detailed ways

[0030] 下面参照附图对本发明进行更全面的描述,其中说明本发明的示例性实施例。 [0030] The following more fully described with reference to the accompanying drawings of the present invention, wherein the exemplary embodiments described exemplary embodiment of the present invention.

[0031] 如图1所述,为本发明系统的结构示意图,包括:增强现实业务处理平台1和资讯平台2。 [0031] FIG. 1 is a schematic structural diagram of a system of the present invention, comprising: an augmented reality service processing platform 2 and the information platform.

[0032] 再如图1所示,增强现实业务处理平台1包括位置获取单元11、方向获取单元12、 图像获取单元13、图像分析单元14、控制单元15、资讯平台管理单元16、以及资讯平台接口单元17。 [0032] Figure 1 again, an augmented reality service processing platform includes a position acquisition unit 11, the direction acquisition unit 12, an image acquisition unit 13, image analysis unit 14, the control unit 15, internet information management unit 16, and the information platform The interface unit 17. 其中,由于图像信息以及位置信息是必须参数,其他为可选参数,所以,方向获取单元12是可选单元,是为获取更好的效果而增加的单元。 Wherein, since the image information and the position information is mandatory parameters, optional parameters for the other, so that the direction acquisition unit 12 is an optional unit, to obtain better results is to increase the unit. 下面对设置在增强现实业务处理平台1中的各个单元进行详细说明: Next, the respective units arranged in an augmented reality service processing platform 1 will be described in detail:

[0033] 位置获取单元11,用于获取所处地点的位置信息,将位置信息传送给控制单元,位置信息即经纬度信息,位置获取单元11可以是卫星(GPS、北斗)定位模块、基站定位模块或wifi定位模块等。 [0033] The position obtaining unit 11, configured to obtain location information of the location in which the location information to the control unit, i.e. the position information of latitude and longitude information, the position acquisition unit 11 may be a satellite (GPS, Beidou) positioning module, the base station positioning module wifi positioning module or the like.

[0034] 方向获取单元12,用于获取方向信息,将方向信息传送给控制单元,方向信息比如摄像头所指的方向。 [0034] direction acquisition unit 12 for acquiring direction information, the direction information transmitted to the control unit, such as a camera direction information is referred to. 方向获取单元12可以是电子罗盘、陀螺仪或重力感应模块等。 Direction acquisition unit 12 may be an electronic compass, gyroscope, or other motion sensor. 获取的方向可以是东、西、南、北、垂直或仰角等。 Direction can be obtained east, west, south, north, such as vertical or elevation.

[0035] 图像获取单元13,用于获取图像信息,将图像信息传送给图像分析单元14,图像信息比如是摄像头拍摄到的图像,包括动态摄像和静态摄像。 [0035] The image acquiring unit 13 for acquiring image information, transmitting the image information to the image analysis unit 14, information such as an image is captured camera images, including static and dynamic imaging camera. 优选地,图像获取单元13还在屏幕上实时显示图像信息。 Preferably, the displayed image information in real time on the screen of the image acquisition unit 13 also.

[0036] 图像分析单元14,用于对图像获取单元13获取的图像信息进行特征分析,提取图像特征,将图像特征传送给控制单元。 [0036] The image analysis unit 14, an image acquisition unit for acquiring image information 13 of the feature analysis feature extraction image, wherein the image transferred to the control unit. 所述图像特征是用于描述图像的信息,可以是图像的形状特征、颜色特征或纹理特征等。 Wherein the image information is used to describe the image, the shape may be a feature of the image, color or texture features and other features. 作为一种实施方式,所述图像特征是增强显示业务平台所拍摄的原始图片,其格式包括但不限于JPG、BMP、GIP、PNG等;作为另一种实施方式,所述的图像特征是增强显示业务平台根据所拍摄的原始图片,进行图像处理,提取出的图像。 As an embodiment, the image display characterized by enhanced service platform original picture taken, including but not limited to the format JPG, BMP, GIP, PNG and the like; As another embodiment, wherein the image enhancement show business platform based on the original picture taken, image processing, the extracted image.

[0037] 目前图像识别领域有很多提取图像特征的算法。 [0037] There are many current field of image recognition of the image feature extraction algorithm. 图像分析单元14可以位于终端上,如图1所示;也可以位于网络侧业务平台,如图2所示;还可以如图3所示,在业务平台以及资讯平台都设置图像分析单元。 The image analysis unit 14 may be located on the terminal shown in Figure 1; may be located at the network side service platform shown in Figure 2; also shown in Figure 3, the service platform and the information platform are provided an image analysis unit. 业务平台侧的图像分析单元可以做初步的分析,也可以不做分析直接给资讯平台处理。 The image analysis unit service platform side can do a preliminary analysis, the analysis can not give direct information processing platform. 资讯平台做专业的图像分析,并要和图像库结合,如人脸识别、商标识别、商品识别等。 Information platform to do a professional image analysis and image library and you want to combine, such as face recognition, brand identification, product identification and so on.

[0038] 控制单元15分别与位置获取单元11、方向获取单元12、图像获取单元13、图像分析单元14连接,可以通过通信网络连接,所述通信网络可以是移动网络,比如CDMA2000、 WCDMA、TD-SCDMA、WiFi等网络,进行业务流程的控制,实现资讯的请求和发送。 [0038] The control unit 15 respectively the position acquisition unit 11, the direction acquisition unit 12, an image acquisition unit 13, image analysis unit 14 is connected, may be connected through a communication network, the communication network may be a mobile network, such as CDMA2000, WCDMA, TD -SCDMA, WiFi network, etc., for controlling the business process, and transmit information to achieve the request. 控制单元15 用于将图像特征和位置信息携带在请求参数中,以及确定请求参数要发往的资讯平台。 The control unit 15 for the image and feature information is carried in the location request parameters, the request parameters and determining information to be sent to the internet.

[0039] 其中,业务平台可以将图片直接作为图像特征,图片格式可以是JPG、BMP、GIF等; 业务平台也可以先分析出图像的一些轮廓特征,将轮廓特征作为图像特征。 [0039] The service platform may be directly used as an image feature image, image format can be JPG, BMP, GIF and the like; service platform may be analyzed to outline some features of an image, the outline feature as an image feature. 优选地,当控制单元还获取方向信息和/或搜索范围时,在请求参数中还携带方向信息和/或搜索范围。 Preferably, when the control unit further acquires direction information and / or the search range, the parameter in the request also carries information about the direction and / or the search range.

[0040] 控制单元15根据业务逻辑确定,具体将请求参数发到哪个或哪几个资讯平台。 [0040] The control unit 15 determines according to the service logic, the request parameters specific to send information about which carrier or internet.

[0041] 作为本发明的一个实施例,控制单元确定资讯平台的操作可以是,实施方式1 :控制单元将资讯平台以列表形式呈现给用户,用户点击界面,控制单元根据点击确定用户选择的资讯平台。 [0041] As the present embodiment of the invention, the control unit determines the operation information platform may be, Embodiment 1: the control unit the information platform presented in a list to the user, the user clicks on the interface, the control unit determines the information selected by the user based on clicks platform. 实施方式2 :控制单元根据图像特征来确定,如根据图像特征识别出是人物的图像,则搜索资讯平台管理单元,获取进行人物识别的资讯平台连接地址,确定将请求参数发到对应的资讯平台处理。 Embodiment 2: The control unit determines according to image characteristics, image is a person as identified according to image characteristics, the search information platform managing unit, acquires for personal recognition information platform connection address, determines the request parameter sent to the corresponding information platform deal with.

[0042] 资讯平台管理单元16用于管理资讯平台的信息,包括资讯平台信息库,信息库可以包括类别和资讯平台连接地址,还可以包括资讯平台标识等,每个资讯平台都在该信息库中有一条对应的记录。 [0042] Information internet information management unit 16 for managing the information platform, the platform including information repository, the repository may include a connection category and address information platform, the platform may further comprise identification information and the like, each of the information platform in the warehouse there is a corresponding record.

[0043] 其中,根据实施方式可以有多种类别,如建筑类、人物类、商品类、植物类等;资讯平台标识用于标识资讯平台,可以是资讯平台的名称或资讯平台的编号等;资讯平台的连接地址是用于连接资讯平台,可以是IP地址、操作系统的调用连接地址或Web域名地址等。 [0043] wherein, according to an embodiment may have various categories, such as construction type, character type, commodities, plants and the like; internet identification information for identifying the information platform, the information may be a name or number of internet information platform, and the like; connection address information platform is used to connect information platform can be an IP address, operating system calls the connection address of the domain name, or Web address.

[0044] 资讯平台接口单元17用于和各个资讯平台连接通信,根据接口协议向资讯平台发送请求参数并获取反馈的内容资讯。 [0044] Information for the internet interface unit 17 connected to the platform and the respective communication information, internet information transmission request parameters to acquire the content in accordance with the interface protocol and feedback information. 接口协议为XML协议,也可以是基于TCP/IP的WebService 协议。 XML interface protocol is protocol, it may also be based on TCP / IP protocol WebService.

[0045] 作为本发明的一种实施方式,增强现实业务处理平台1还可以包括融合展现单元18,用于将资讯平台接口单元17获取的内容资讯与图像信息进行融合展现、交互操作,进行虚拟和真实信息的融合展现。 [0045] As an embodiment of the present invention, an augmented reality service processing platform may further include fusion presentation unit 18, the content information and the image information for the internet information acquired by the interface unit 17 to show the fusion, interaction, virtual and integration of real information show.

[0046] 例如:业务平台将建筑物信息发给资讯平台后,资讯平台返回商家的招牌信息,以及和大楼融合展现的相对位置,融合展现单元18将商家招牌的虚拟标签和镜头的实景进行融合,展现给用户。 [0046] For example: the service platform building information to the information platform, information platform of business information signs, as well as the building and integration of the relative position of the show, to show the integration of the virtual tag unit 18 and lens businesses real signs of fusion , presented to the user.

[0047] 如图2所示,本发明系统的结构示意图,其中图像分析单元设置在业务平台。 [0047] As shown in FIG 2, a schematic structural diagram of the inventive system, wherein the image analysis unit provided service platform. 资讯平台2包括接口单元21、连接单元22、以及内容管理单元23。 Information platform 2 includes an interface unit 21, a connecting unit 22, and a content management unit 23. 资讯平台可以有一个或多个。 Information platform may have one or more. 不同的资讯平台可以提供不同类型的资讯信息,或提供不同区域的资讯信息。 Different information platform can provide different types of news and information, or to provide news and information in different regions. 由增强现实业务处理平台1根据业务需要,决定向一个或多个资讯平台发送请求。 By the AR service 1 processing platform based on business needs, we decided to send a request to one or more of the information platform. 其中: among them:

[0048] 接口单元21具有连接地址,用于和增强现实业务处理平台1连接通信,获取请求参数并反馈内容资讯。 [0048] The interface unit 21 has a connection address, and augmented reality service processing for internet communication connection, the content acquisition request parameters and feedback information. 本实施例中,请求参数包括图像特征和位置信息,还可以包括搜索范围和/或方向信息等,连接地址是IP地址,通信协议为XML协议。 In this embodiment, the request includes an image feature parameter and position information may also include a search range and / or orientation information, link address is the IP address, the communication protocol is XML protocol.

[0049] 连接单元22分别与接口单元21、内容管理单元23连接,用于从接口单元21获取请求参数,从内容管理单元23获取与请求参数匹配的内容资讯,将内容资讯传送给接口单元21。 [0049] The connection means 22 are 21, the content management unit 23 is connected to the interface unit, the parameter acquisition request from the interface unit 21, from the content management unit 23 acquires the requested content information matching parameter, transmitting the content information to the interface unit 21 for .

[0050] 内容管理单元23,用于根据请求参数搜索到匹配的内容资讯并传送给连接单元22。 [0050] The content management unit 23, according to a request for searching content matching the parameter information and transmitted to the connector unit 22. 具体实施方式、算法是由各资讯平台来确定。 Specific embodiment, the algorithm is determined by the information platform. 所述内容资讯可保存在资讯平台内部,即内容管理单元23保存内容资讯,并直接提供给连接单元;内容资讯也可以保存在外部,即内容管理单元23不保存内容资讯,在连接单元22要获取内容资讯时,由内容管理单元23 通过网络连接获取并提供给连接单元22。 The information can be stored in the internal information content platform, the content management unit 23 stores content information, and directly to the connection unit; content information may be stored in the external, i.e., the content management unit 23 does not save the contents of the information, to the connecting unit 22 when obtaining content information management unit 23 is connected via a network by the content acquisition unit 22 and supplied to the connector. 比如餐饮企业的内容资讯包括餐馆名称、餐馆介绍、订餐电话等;旅游景点的内容资讯包括景点名称、景点介绍、票价信息等。 Such as catering business content information includes the name of the restaurant, the restaurant introduced, such as reservations, please call; attractions attractions include the name of the content information, attractions, ticket information.

[0051] 如图1所示,下面通过具体实施例进行说明。 [0051] 1, will be described below by way of specific examples.

[0052] 在本实施例中,向用户提供了“全息窗”业务,基于定位、增强现实(AR)、图像识别等技术,利用手机图像采集等感知能力,根据用户环境提供准确信息的智能移动互联网信息。 [0052] In the present embodiment, to provide the user with "holographic window" service, based positioning, AR (the AR), an image recognition technology, use of mobile phones image capture other perception, provide accurate information according to a user environment intelligent mobile Internet information. 用户通过增强现实业务处理平台的“全息窗“客户端,用手机拍摄景物时,在实景上可看到相关介绍或链接,直达网络资讯,开启一道从现场实景连接网络世界的窗户。 Users through augmented reality business process platform "holographic window" client, when shooting the scene using a mobile phone, can be seen on real or links related presentations, direct access to network information and open the windows a network connection from the field real world.

[0053] 本实施例中,增强现实业务处理平台1包括2大部分,即网络侧部署“全息窗”业务平台(简称业务平台),业务平台包括资讯平台管理单元16、资讯平台接口单元17、控制单元15几个部分;另一部分是安装在终端上的“全息窗”客户端,包括:位置获取单元11、 方向获取单元12、图像获取单元13 (即手机摄像头)、图像分析单元14,还有融合展现单元和移动通信单元。 [0053] In this example embodiment, an augmented reality service processing platform comprises two parts, i.e. the network side deploying 'hologram window "service platform (the service platform), internet service platform including information management unit 16, the interface unit 17 information platform, 15 several parts of the control unit; the other is "holographic window" client installed on the terminal, comprising: a position acquisition unit 11, the direction acquisition unit 12, an image acquisition 13 (i.e., cell phone camera) unit, an image analysis unit 14, further there fusion presentation unit and the mobile communication unit.

[0054] 在此实施例中,“全息窗”业务平台实现了基于手机拍摄的智能信息应用门户和网关平台,通过本发明的接口交互方法,定义了全息窗业务平台和资讯平台之间的增强型AR 接口交互协议。 [0054] example, "Holographic window" service platform based mobile phones to take intelligent information application portal and gateway platform in this embodiment, through the interface interactive method of the invention, the definition of an enhanced holographic window between the business platform and information platform type AR interactive interface protocol. 通过本业务平台可聚合及集成了商家、风景点、商品、房地产、社区、人员招聘等内容资讯。 Through this business platform aggregation and integration of businesses, scenic spots, commodities, real estate, community, staff recruitment and other content information. “全息窗”业务平台和资讯平台之间通过IP网络相连接。 Connected via an IP network between the "holographic window" service platform and information platform.

[0055] 以2个资讯平台为例,如图1所示,其中,资讯平台2-1是餐饮资讯平台,资讯平台2-2是旅游景点资讯平台。 [0055] In Case 2 information platform, shown in Figure 1, wherein the information platform information platform catering 2-1, 2-2 is a tourist attraction information platform information platform. 在本实施例中,所述的2个资讯平台是分别提供餐饮信息和旅游景点信息的互联网网站。 In this embodiment, the two are information platform is to provide information and Internet sites catering tourist attractions information.

[0056] 资讯平台2-1存储有餐饮企业的关联内容资讯,包括餐馆名称、餐馆介绍、订餐电话等,记录有每个餐饮企业的经纬度信息、空间位置信息、企业的图片外观特征、Logo特征等。 [0056] 2-1 stored information platform catering business related content information, including the name of the restaurant, the restaurant introduced, such as reservations, please call, each catering enterprises recorded the latitude and longitude information, spatial location information, pictures appearance characteristics of enterprises, Logo features Wait.

[0057] 资讯平台2-2存储有旅游景点的关联内容资讯,包括景点名称、景点介绍、票价信息等,记录有每个旅游景点的经纬度信息、空间位置信息、景色特征等。 [0057] Information Platform 2-2 stores content information related tourist attractions, including the name attractions, attractions, fares and other information is recorded for each tourist attractions latitude and longitude information, spatial location information, views and other features.

[0058] 如图4所示,为本发明获取移动增强现实信息的方法,通过该方法可以获取内容资讯,并进一步对获取的内容资讯进行融合展现,例如:需将一个商家标签叠加在一栋大楼上,增加了楼层图像特征后,资讯平台可以根据楼层图像特征找到相应楼层对应的商家,将该商家信息返回给业务平台,经业务平台发送给终端;终端还可以根据商家信息中包括的图像结构特征,将信息点叠加在镜头图像中和该结构匹配的位置,从而与实景精确匹配。 [0058] As shown, the method of the present invention, a mobile AR 4 acquiring information, the information content may be obtained by this method, and further the content information acquired fusion show, for example: a merchant need to be superimposed on a label the building, the floor increases the image feature, the information platform may find the image feature corresponding floor by floor corresponding merchant, the merchant returns the information to the service platform, the service platform transmits to the terminal; the merchant terminal may further include an image information structural features, the information dots in the superimposed position of the lens structure and the image matching, so as to precisely match the real. 该方法包括以下步骤: The method comprises the steps of:

[0059] 在步骤401,增强现实业务处理平台获取图像信息,对图像信息提取图像特征。 [0059] In step 401, the augmented reality service processing platform obtains image information, extracts the image feature of the image information.

[0060] 作为一个实施例,可以通过运行在手机侧的客户端摄像头来获取图像信息。 [0060] As an example, image information can be acquired by a client running on the mobile phone side cameras. 例如手机对着城市中的一个大楼,则所获取的图像信息是大楼的照片。 For example mobile phone in front of a building in the city, the acquired image information is a photograph of the building. 优选地,客户端调用手机接口获取手机的位置和方向参数,即增强现实业务处理平台还可以获取景物的位置、方向和/或搜索范围。 Preferably, the client calls the phone interface to obtain the phone's location and orientation parameters, namely AR service processing platform can also obtain the location of the scene, direction, and / or search.

[0061] 在步骤402,增强现实业务平台确定目标资讯平台地址,根据目标资讯平台地址连接一个或多个资讯平台。 [0061] In step 402, the service platform determines a target AR internet address information, connection information platform according to one or more target address information platform.

[0062] 本实施例中,“全息窗”客户端在界面上呈现出多个可选的目标资讯平台的名称列表,例如“ 1.餐饮资讯”、“2.旅游景点资讯”,根据用户点击选择来确定目标资讯平台地址, 如果用户点击了“1.餐饮资讯”,则客户端将选择信息通过移动通信网络传送给网络侧业务平台,网络侧业务平台已保存该资讯平台的地址,根据资讯平台标识可以在已保存的数据库中检索确定,即对应的资讯平台2-1的地址,如IP地址“10. 17. 48. 196”。 [0062] In this embodiment, "holographic window" client interface presented on a number of optional list of names target information platform, such as "1. Restaurant Information", "2. Tourist attractions information," according to the user clicks select to determine the destination address information platform, if the user clicks the "1 restaurant information", the client will select information via the mobile communications network to the network side service platform, network side service platform has been saved address of the information platform, based on the information internet has been determined can be retrieved identification stored in the database, i.e., the address information corresponding to the 2-1 platform, such as IP address "10 17 48.196."

[0063] 作为另一个实施例,业务平台还可以根据图像特征来确定,如根据图像特征识别出是人物的图像,则搜索获取进行人物识别的资讯平台连接地址。 [0063] another embodiment, the service platform may also be determined from the image as a feature, as is recognized in accordance with the image feature image of a person, the search for personal recognition information acquired internet connection address.

[0064] 在步骤403,增强现实业务处理平台将图像特征和位置信息携带在请求参数中,将请求参数发到目标资讯平台处理。 [0064] In step 403, the AR internet service processing image feature and the position information carried in the request parameters, the request parameter sent to the target platform for processing information.

[0065] 本实施例中,接口中增加了图像特征,然后对图像特征进行识别和搜索等处理操作,可以先后或分别在业务平台端和资讯平台端进行,根据图像特征不同和处理方式不同包括多种实施方式。 [0065] In this embodiment, the interface added to image features, and image features to identify and search processing operations can be sequentially or separately in the business end of the platform and the information platform end, according to image characteristics different and processed in different ways including various embodiments. 所述图像特征包括图像特征点的结构、颜色等属性。 The image feature points of the image feature comprises a structure, color and other attributes.

[0066] 通过增强现实业务处理平台与资讯平台之间的接口,对于步骤403,将请求参数发到目标资讯平台,以及步骤404,资讯平台根据请求参数进行搜索,还可以包括以下情况: [0066] By reinforcing the interface between the processing platform and real-world business information platform, for step 403, the request is sent to the target parameter information platform, and a step 404, the request information platform searches based parameters may also include the following:

[0067] 当请求参数中还携带搜索范围时,资讯平台根据位置信息和搜索范围进行搜索, 确定目标范围后,再根据图像特征进行匹配; After [0067] When the request further carries parameter search range information platform searches the position information and the search range, determining a target range, then the image feature matching;

[0068] 当请求参数中还携带方向信息时,资讯平台根据位置信息和方向信息进行搜索, 确定目标范围后,再根据图像特征进行匹配;或者 After [0068] When the request further carries parameter direction information, information platform searches the position information and direction information, determining a target range, then the image feature matching; or

[0069] 当请求参数中还携带方向信息和搜索范围时,资讯平台根据位置信息、方向信息和搜索范围进行搜索,确定目标范围后,再根据图像特征进行匹配。 [0069] When the request further carries parameter search range and direction information, information platform searches based on the position information, direction information, and the search range, after determining a target range, then the image feature matching.

[0070] 在步骤404,资讯平台根据请求参数进行搜索,获取与请求参数匹配的内容资讯, 所述内容资讯例如内容信息点名称、简介、照片、电话、可执行操作等,返回给增强现实业务处理平台。 [0070] In step 404, information search platform based on request parameters, acquisition parameters and request content information matching the content information such as content information point name, description, photos, phone, perform operation and return to the business of augmented reality processing platform.

[0071] “全息窗”业务平台连接“1.餐饮资讯”对应的资讯平台2-1,将客户端获取的图像信息(大楼照片)、位置发送给资讯平台2-1,资讯平台2-1进行处理。 [0071] "holographic window" service platform connection "1. Restaurant Information" information platform corresponding to 2-1, the image information (Building Photo) obtained by the client, location information is sent to the platform 2-1, 2-1 information platform for processing. 本实施例中,资讯平台处理方式是,资讯平台已经保存了城市中所有商业大楼的照片、位置,根据位置先确定候选的几个大楼,对大楼照片进行图像特征提取,据此进行图像特征匹配,准确确定对准的目标大楼,然后将数据库中该大楼的名称、各楼层进驻的商家信息取出,将商家信息通过接口反馈给“全息窗”业务平台。 In this embodiment, information platform approach, the information platform has saved the city all commercial buildings photo, location, make sure the building a few candidates based on the location of the building picture image feature extraction, feature matching image accordingly and accurately determine the alignment of the target building, and then the name of the database in the building, each floor stationed out of business information, business information through the interface will be fed back to the "holographic window" service platform.

[0072] 作为实施例,反馈信息中,每个商家信息都有和大楼照片匹配的图像特征和位移控制信息,如商家“肯德基”在3楼,则在反馈给业务平台的商家信息中,包括融合展示时在图片中嵌入位置的标记信息。 [0072] As an embodiment, the feedback information, each of the listings and the building has matched photo image feature displacement and control information, such as merchant "KFC" on the third floor, then the feedback information to the merchant service platform, comprising fusion display tag information embedded position in the picture.

[0073] 以下是本实施例步骤403〜步骤404中“全息窗”业务平台和资讯平台2_1交互的协议示范: [0073] The following is an exemplary protocol embodiment of the present embodiment step 403~ step 404. "holographic window" internet service platform and info interaction 2_1:

[0074] “全息窗”业务平台向资讯平台2-1地址(10. 17. 48. 196)提交的请求参数: [0074] Request Parameters "holographic window" filed in the service platform address information platform 2-1 (10. 17. 48.196):

[0075] [0075]

<?xml version="1.0" encoding="UTF-8"?> <dxcontent> <latitude>23.2433<latitude> <longtitude>113.2344<longitude> <range>400<range> <angle>30<angle> <? Xml version = "1.0" encoding = "UTF-8"?> <Dxcontent> <latitude> 23.2433 <latitude> <longtitude> 113.2344 <longitude> <range> 400 <range> <angle> 30 <angle>

<pic_url>http://10.17.10.10/UploadFiles/2010/6/201006281149085499.jpg</pic_url> <PicFeature>A10120 B9392 C2330 D3099 E3899<PicFeature> <Pic_url> http://10.17.10.10/UploadFiles/2010/6/201006281149085499.jpg </ pic_url> <PicFeature> A10120 B9392 C2330 D3099 E3899 <PicFeature>

</content> </ Content>

[0076] [0076]

</dxcontent> </ Dxcontent>

[0077] 其中latitude、longitude是目标建筑物的大致经纬度,range是搜索的半径范围,angle是水平视觉角度,pic_url是图片的地址,PicFeature是业务平台对图像进行初步处理后形成的图像中的特征点标记信息,本实施例中,所述的图像信息即是pic_url和PicFeature0 [0077] wherein latitude, longitude substantially latitude and longitude of the target structure, range search is radius, angle is a horizontal viewing angle, pic_url address of a picture, PicFeature image is formed after the service platform of the preliminary image processing features tag information point, according to the present embodiment, the image information that is pic_url and PicFeature0

[0078] 资讯平台2-1根据经纬度和搜索的半径范围400米内,在资讯平台的建筑物信息库中搜索,找到候选的建筑物,然后根据pic_url获取大楼图片,利用现有图像识别技术在候选建筑物图片中找到和pic_url中的图片最匹配的大楼,作为目标大楼,在识别时候利用了PicFeature的特征点标记来加速匹配。 [0078] Information Platform 2-1 according to latitude and longitude, and search radius within 400 meters in building information database information search platform, to find a candidate of the building, and then get the picture based on the building pic_url, using the existing image recognition technology in the candidate building and pic_url pictures found in the picture that best matches the building, the building as a target, in recognition when using the feature points PicFeature markers to accelerate match. 确定目标大楼后,将数据库中该大楼各楼层的商家信息取出,将商家信息通过接口反馈给“全息窗”业务平台,反馈的信息如下: After determining the target building, each floor of the business building information out of the database, the business information through the interface back to the "holographic window" service platform, information feedback is as follows:

[0079] [0079]

Figure CN102194007AD00101

[0080] 其中name是商家的名称,introduction是商家简介,pic_url是商家的标签, latitude和longitude是商家的实际经纬度,pos ctrl是商家标签现实照片和虚拟标签融合展示时候,在图片中嵌入位置的标记信息,如嵌入到大楼的第三层位置,本实施例中该位置通过与原图片中的特征点的偏离量来标识。 [0080] where name is the name of the business, introduction is business profile, pic_url is the business of the label, latitude and longitude is the actual latitude and longitude of the business, pos ctrl is the business label the reality and the virtual tag fusion show when embedded position in the picture tag information, such as embedded in a third layer position in the building, in this embodiment the position deviation amount is identified by the feature point of the original image in the present embodiment.

[0081] 作为本发明的一个方法实施例,还可以包括步骤405,在步骤405,增强现实业务处理平台获取资讯平台提供的内容资讯,在终端屏幕上进行呈现。 [0081] As one embodiment of the method of the present invention, may further comprise step 405, in step 405, the augmented reality service processing platform obtains content information provided by the information platform, for presentation on the terminal screen.

[0082] “全息窗”业务平台获取以上协议中反馈的“肯德基”的商家信息,在图片中和pos ctrl标记的对应位置中,嵌入“肯德基”的商家标签,即商家名称,或者从pic_url获取商家标记图片,从而实现现场实景和虚拟标签的准确地获取和准确地融合展现。 [0082] "holographic window" business internet access "KFC" listing more protocols feedback in a corresponding location in the image and pos ctrl labeled, embedding "KFC" business label, i.e. business name, or acquired from pic_url business marker picture, in order to achieve real and virtual site labels accurately acquire and accurately fused show.

[0083] 优选地,在步骤404中,资讯平台还将内容资讯的展示控制参数返回给增强现实业务处理平台,展示控制参数可以包括关联的图像特征和/或偏移量等。 [0083] Preferably, in step 404, control parameter information platform will display the contents of AR information is returned to the operating platform may include an image display control parameter associated features and / or offset and the like. 相应地,在步骤405中,增强现实业务处理平台结合所获取的展示控制参数,在屏幕上和展示控制参数相匹配的地方展示内容资讯。 Accordingly, in step 405, the control parameters reality show enhanced business process platform combines the acquired place on the screen and display the control parameters to match the display of content information.

[0084] 利用本发明,用户进行增强现实体验时,获取更多的环境参数作为请求参数,包括位置信息和图像信息,还可以包括方向信息和/或搜索范围等,在资讯平台进行内容资讯获取的时候,通过请求参数进行多参数的搜索筛选,从资讯平台获取内容资讯,提高信息获取的准确性,实现与现实场景的精准匹配和叠加,优化用户的交互体验,可支持图像搜索等更多应用。 [0084] When using the present invention, the user augmented reality experience, more of the environmental parameters as a request parameter, including the position information and the image information may also include directional information and / or the search range and the like, content information acquired in the information platform time, multi-parameter by parameter request filter, acquiring content information from the information platform to improve the accuracy of the information obtained, and achieve precise matching and superimposed reality scene, optimize the user's interactive experience that supports image search, and more application.

[0085] 本发明的描述是为了示例和描述起见而给出的,而并不是无遗漏的或者将本发明限于所公开的形式。 [0085] The description of the present invention are exemplary and given in order of description, and not to be exhaustive or to limit the invention to the form disclosed. 很多修改和变化对于本领域的普通技术人员而言是显然的。 Many modifications and variations to those of ordinary skill in the art is obvious. 选择和描述实施例是为了更好说明本发明的原理和实际应用,并且使本领域的普通技术人员能够理解本发明从而设计适于特定用途的带有各种修改的各种实施例。 The embodiments were chosen and described in order to best explain the principles and practical applications of the present invention and enable one of ordinary skill in the art to understand the invention for various design suited to the particular use with a variety of modified embodiments.

Claims (10)

1.获取移动增强现实信息的系统,其中: 增强现实业务处理平台包括:位置获取单元,用于获取所处地点的位置信息,将位置信息传送给控制单元; 图像获取单元,用于获取图像信息,将图像信息传送给图像分析单元; 图像分析单元,用于对图像获取单元获取的图像信息进行特征分析,提取图像特征,将图像特征传送给控制单元;控制单元分别与位置获取单元、方向获取单元、图像获取单元、图像分析单元连接,用于将图像特征和位置信息携带在请求参数中,以及确定请求参数要发往的资讯平台;资讯平台管理单元,用于管理资讯平台的信息,包括资讯平台信息库,每个资讯平台都在该信息库中有对应的记录;资讯平台接口单元,用于和各个资讯平台连接通信,根据接口协议向资讯平台发送请求参数并获取反馈的内容资讯; 资讯平台包括:接口 1. Get mobile augmented reality system information, wherein: the augmented reality service processing platform, comprising: a position acquisition unit for acquiring position information which location the location information to the control unit; an image acquiring unit for acquiring image information , the image analysis unit transmits information to the image; an image analyzing unit for the image information acquiring unit acquiring image feature analysis, image feature extraction, feature transfers the image to the control unit; and a control unit are a position acquisition unit, acquires a direction unit, an image acquisition unit, an image analysis unit connected to the image feature and the position information carried in the request parameters, the request parameters and determining information to be sent to the internet; internet information management unit for managing information of the information platform, comprising repository information platform, each platform has the corresponding information recorded in the information repository; information platform interface unit and connected to the respective communication information platform, internet information transmission request parameters to acquire the content in accordance with the interface protocol and of the feedback information; information platform includes: an interface 元,具有连接地址,用于和增强现实业务处理平台连接通信,获取请求参数并反馈内容资讯;连接单元,分别与接口单元、内容管理单元连接,用于从接口单元获取请求参数,从内容管理单元获取与请求参数匹配的内容资讯,将内容资讯传送给接口单元;内容管理单元,用于根据请求位置、图像特征参数搜索到匹配的内容资讯并传送给连接单元。 Element, having a connection address, and augmented reality service for connecting a communication processing platform, and feeds back the content acquisition request parameter information; connecting means are connected to the interface unit, the content management unit, a request for acquiring the parameters from the interface unit, from the content management means acquires the content information with parameters matching the request, transmitting the content information to the interface unit; content management unit, according to a search request for position matching to the image characteristic parameter and transmitted to the content information connecting unit.
2.根据权利要求1所述获取移动增强现实信息的系统,增强现实业务处理平台还包括:方向获取单元,用于获取方向信息,将方向信息传送给控制单元。 According to claim 1 to the mobile acquires information required enhancement system reality, augmented reality service processing platform further comprises: a direction acquiring unit for acquiring direction information, the direction information transmitted to the control unit.
3.根据权利要求2所述获取移动增强现实信息的系统,其中: 控制单元还将方向信息和/或搜索范围携带在请求参数中。 3. The system for acquiring movement information of the AR as claimed in claim 2, wherein: the control unit further direction information and / or search range parameters carried in the request.
4.根据权利要求1所述获取移动增强现实信息的系统,其中:控制单元将资讯平台以列表形式呈现在终端,将已选择的资讯平台确定为请求参数要发往的资讯平台;或者根据图像特征搜索资讯平台管理单元,将与图像特征匹配的资讯平台确定为请求参数要发往的资讯平台。 The system obtains information of the mobile AR claimed in claim 1, wherein: the control unit the information platform presented in tabular form in the terminal, the selected parameter information platform determines that a request to be sent to the information platform; or an image wherein the search information platform management unit, matched with the image feature information platform determines that a request to send the parameter information to the internet.
5.根据权利要求1所述获取移动增强现实信息的系统,其中:图像分析单元位于终端或网络侧业务平台,或者在网络侧业务平台以及资讯平台都设置图像分析单元。 The system obtains information of the mobile AR claimed in claim 1, wherein: the image analysis unit located at the terminal side or the network service platform, or network information service platform, and platforms provided an image analysis unit.
6.根据权利要求1至5中任一所述获取移动增强现实信息的系统,增强现实业务处理平台还包括:融合展现单元,用于将获取到的内容资讯与现实图像进行融合展现。 According to claim 1 to 5, in any of a reinforcing system for acquiring movement information of reality, augmented reality service processing platform further comprises: fusion presentation unit, for content information with the acquired real image to show fusion.
7.获取移动增强现实信息的方法,包括如下步骤:增强现实业务处理平台获取图像信息,对图像信息提取图像特征; 增强现实业务处理平台确定要建立连接的资讯平台,根据资讯平台地址连接一个或多个资讯平台;增强现实业务处理平台将图像特征和位置信息携带在请求参数中,将请求参数发到资讯平台;资讯平台根据请求参数进行搜索,获取与请求参数匹配的内容资讯,返回给增强现实业务处理平台。 7. A method for acquiring movement information of the AR, comprising the steps of: acquiring AR internet service processing image information, extracting image feature information of an image; AR service processing platform determines to establish a connection information platform, according to a connection or address information platform a plurality of information platform; AR internet service processing image feature and the position information carried in the request parameters, the request to send the parameter information platform; internet search information depending on the request, acquires the requested content information matching parameter, to enhance the return real business processing platform.
8.根据权利要求7所述获取移动增强现实信息的方法,增强现实业务处理平台确定要建立连接的资讯平台的操作,包括以下步骤:业务平台将资讯平台以列表形式呈现在终端,当用户选择资讯平台后,将已选择的资讯平台确定为要建立连接的资讯平台;或者业务平台根据图像特征进行搜索,将与图像特征匹配的资讯平台确定为要建立连接的资讯平台。 A method for acquiring movement information of the AR according to claim 7, AR internet service processing operation is determined to establish a connection information platform, comprising the steps of: internet service platform presented in the terminal information in list form, when the user selects after the information platform, the platform has been selected information is determined to establish information platform connection; or service platform search by image feature that will match with the image feature information platform determined to establish information platform connection.
9.根据权利要求7或8所述获取移动增强现实信息的方法,将请求参数发到资讯平台, 资讯平台根据请求参数进行搜索的操作,还包括以下步骤:当请求参数中还携带搜索范围时,资讯平台根据位置信息和搜索范围进行搜索,确定目标范围后,再根据图像特征进行匹配;当请求参数中还携带方向信息时,资讯平台根据位置信息和方向信息进行搜索,确定目标范围后,再根据图像特征进行匹配;或者当请求参数中还携带方向信息和搜索范围时,资讯平台根据位置信息、方向信息和搜索范围进行搜索,确定目标范围后,再根据图像特征进行匹配。 When a request further carries parameter search range: 9. A method for acquiring mobile AR information, the request parameter sent to the information platform, the information platform searches operating parameters according to the request, further comprising the step of according to claim 7 or 8 , the information platform based on the position information and the search range of the search after determining a target range, then the matching according to image characteristics; when requested parameter further carries the direction information, the information platform searches the position information and direction information, determining a target range, the then matching according to image characteristics; or when the request further carries parameter search range and direction information, information platform searches based on the position information, direction information, and the search range, determining a target range, then the image feature matching.
10.建立业务平台与资讯平台之间连接的接口,包括:资讯平台接口单元,设置在业务平台,用于和各个资讯平台连接通信,根据接口协议向资讯平台发送请求参数并获取反馈的内容资讯,所述请求参数包括位置信息和图像特征;接口单元,设置在资讯平台,具有连接地址,用于和业务平台连接通信,获取请求参数并反馈与所述请求参数匹配的内容资讯。 10. The interfacing between the service platform and connected to the information platform, comprising: an interface unit information platform, the service platform is provided, and each of the information platform for the communication connection, internet information transmission request parameters to acquire the content in accordance with the interface protocol and feedback information the parameter request including location information and the image feature; interface unit provided in the information platform, having a connection address, and the service platform for the communication connection, and an acquisition request feedback parameter of the requested content information matching parameter.
CN201110144014.7A 2011-05-31 2011-05-31 System and method for acquiring mobile augmented reality information CN102194007B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110144014.7A CN102194007B (en) 2011-05-31 2011-05-31 System and method for acquiring mobile augmented reality information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110144014.7A CN102194007B (en) 2011-05-31 2011-05-31 System and method for acquiring mobile augmented reality information

Publications (2)

Publication Number Publication Date
CN102194007A true CN102194007A (en) 2011-09-21
CN102194007B CN102194007B (en) 2014-12-10

Family

ID=44602076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110144014.7A CN102194007B (en) 2011-05-31 2011-05-31 System and method for acquiring mobile augmented reality information

Country Status (1)

Country Link
CN (1) CN102194007B (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012126381A1 (en) * 2011-03-22 2012-09-27 百度在线网络技术(北京)有限公司 Device and method for obtaining shared object related to real scene
CN103002410A (en) * 2012-11-21 2013-03-27 北京百度网讯科技有限公司 Augmented reality method and system for mobile terminals and mobile terminals
CN103037305A (en) * 2011-10-09 2013-04-10 北京千橡网景科技发展有限公司 Method and device utilizing mobile terminal to provide user with browse guiding information
CN103164518A (en) * 2013-03-06 2013-06-19 杭州九树网络科技有限公司 Mobile terminal (MT) augmented reality application system and method
CN103309895A (en) * 2012-03-15 2013-09-18 中兴通讯股份有限公司 Mobile augmented reality searching method, client, server and searching system
CN103391400A (en) * 2012-05-11 2013-11-13 索尼电脑娱乐欧洲有限公司 Method and system for augmented reality
CN103389978A (en) * 2012-05-07 2013-11-13 联想(北京)有限公司 Method and system for acquiring information through augmented reality technologies
CN103488658A (en) * 2012-06-15 2014-01-01 李和平 Content researching method and system based on response of characteristic value information of image frame data
CN103617418A (en) * 2013-11-28 2014-03-05 小米科技有限责任公司 Method, device and terminal equipment for biology recognition
CN103826201A (en) * 2014-02-13 2014-05-28 夷希数码科技(上海)有限公司 Geographical position-based virtual interaction method and system thereof
CN103870485A (en) * 2012-12-13 2014-06-18 华为终端有限公司 Method and device for achieving augmented reality application
CN103959288A (en) * 2011-11-30 2014-07-30 诺基亚公司 Method and apparatus for WEB-based augmented reality application viewer
CN104081379A (en) * 2011-10-27 2014-10-01 电子湾股份有限公司 Visualization of items using augmented reality
CN104081389A (en) * 2011-11-08 2014-10-01 维迪诺蒂有限公司 Image annotation method and system
CN104756149A (en) * 2012-08-31 2015-07-01 脸谱公司 Real-world view of location-associated social data
CN104965887A (en) * 2015-06-16 2015-10-07 安一恒通(北京)科技有限公司 Information acquiring method and apparatus
CN105138763A (en) * 2015-08-19 2015-12-09 中山大学 Method for real scene and reality information superposition in augmented reality
CN105338483A (en) * 2014-08-12 2016-02-17 中国电信股份有限公司 Method, device and system for realizing exhibition hall tour guide based on augmented reality technology
CN105488840A (en) * 2015-11-26 2016-04-13 联想(北京)有限公司 Information processing method and electronic equipment
CN106230920A (en) * 2016-07-27 2016-12-14 吴东辉 A kind of method and system of AR
CN107222529A (en) * 2017-05-22 2017-09-29 北京邮电大学 Augmented reality processing method, WEB modules, terminal and cloud server
TWI615776B (en) * 2016-12-23 2018-02-21 李雨暹 Method and system for creating virtual message onto a moving object and searching the same
CN107748772A (en) * 2017-09-30 2018-03-02 深圳市谷熊网络科技有限公司 A kind of brand recognition method and device
US10210659B2 (en) 2009-12-22 2019-02-19 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101924992A (en) * 2010-07-30 2010-12-22 中国电信股份有限公司 Method, system and equipment for acquiring scene information through mobile terminal

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101924992A (en) * 2010-07-30 2010-12-22 中国电信股份有限公司 Method, system and equipment for acquiring scene information through mobile terminal

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10210659B2 (en) 2009-12-22 2019-02-19 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
WO2012126381A1 (en) * 2011-03-22 2012-09-27 百度在线网络技术(北京)有限公司 Device and method for obtaining shared object related to real scene
CN103037305A (en) * 2011-10-09 2013-04-10 北京千橡网景科技发展有限公司 Method and device utilizing mobile terminal to provide user with browse guiding information
US9449342B2 (en) 2011-10-27 2016-09-20 Ebay Inc. System and method for visualization of items in an environment using augmented reality
US10147134B2 (en) 2011-10-27 2018-12-04 Ebay Inc. System and method for visualization of items in an environment using augmented reality
CN104081379A (en) * 2011-10-27 2014-10-01 电子湾股份有限公司 Visualization of items using augmented reality
CN104081389A (en) * 2011-11-08 2014-10-01 维迪诺蒂有限公司 Image annotation method and system
CN103959288A (en) * 2011-11-30 2014-07-30 诺基亚公司 Method and apparatus for WEB-based augmented reality application viewer
US9870429B2 (en) 2011-11-30 2018-01-16 Nokia Technologies Oy Method and apparatus for web-based augmented reality application viewer
WO2013135132A1 (en) * 2012-03-15 2013-09-19 中兴通讯股份有限公司 Search method, client, server and search system for mobile augmented reality
CN103309895A (en) * 2012-03-15 2013-09-18 中兴通讯股份有限公司 Mobile augmented reality searching method, client, server and searching system
CN103309895B (en) * 2012-03-15 2018-04-10 中兴通讯股份有限公司 Mobile augmented reality searching method, client, server and search system
CN103389978B (en) * 2012-05-07 2016-10-05 联想(北京)有限公司 A kind of method and system being obtained information by augmented reality
CN103389978A (en) * 2012-05-07 2013-11-13 联想(北京)有限公司 Method and system for acquiring information through augmented reality technologies
CN103391400B (en) * 2012-05-11 2018-01-02 索尼互动娱乐欧洲有限公司 Method and system for the sense of reality of enhancing
CN103391400A (en) * 2012-05-11 2013-11-13 索尼电脑娱乐欧洲有限公司 Method and system for augmented reality
CN103488658A (en) * 2012-06-15 2014-01-01 李和平 Content researching method and system based on response of characteristic value information of image frame data
CN104756149A (en) * 2012-08-31 2015-07-01 脸谱公司 Real-world view of location-associated social data
CN104756149B (en) * 2012-08-31 2018-08-14 脸谱公司 With the real world view of the relevant social data in position
CN103002410B (en) * 2012-11-21 2015-04-08 北京百度网讯科技有限公司 Augmented reality method and system for mobile terminals and mobile terminals
CN103002410A (en) * 2012-11-21 2013-03-27 北京百度网讯科技有限公司 Augmented reality method and system for mobile terminals and mobile terminals
CN103870485A (en) * 2012-12-13 2014-06-18 华为终端有限公司 Method and device for achieving augmented reality application
CN103870485B (en) * 2012-12-13 2017-04-26 华为终端有限公司 Method and device for achieving augmented reality application
CN103164518A (en) * 2013-03-06 2013-06-19 杭州九树网络科技有限公司 Mobile terminal (MT) augmented reality application system and method
CN103617418A (en) * 2013-11-28 2014-03-05 小米科技有限责任公司 Method, device and terminal equipment for biology recognition
CN103826201A (en) * 2014-02-13 2014-05-28 夷希数码科技(上海)有限公司 Geographical position-based virtual interaction method and system thereof
CN105338483B (en) * 2014-08-12 2019-01-18 中国电信股份有限公司 The methods, devices and systems of museum tour guide are realized based on enhancing realization technology
CN105338483A (en) * 2014-08-12 2016-02-17 中国电信股份有限公司 Method, device and system for realizing exhibition hall tour guide based on augmented reality technology
CN104965887A (en) * 2015-06-16 2015-10-07 安一恒通(北京)科技有限公司 Information acquiring method and apparatus
CN105138763A (en) * 2015-08-19 2015-12-09 中山大学 Method for real scene and reality information superposition in augmented reality
CN105488840B (en) * 2015-11-26 2019-04-23 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN105488840A (en) * 2015-11-26 2016-04-13 联想(北京)有限公司 Information processing method and electronic equipment
CN106230920A (en) * 2016-07-27 2016-12-14 吴东辉 A kind of method and system of AR
TWI615776B (en) * 2016-12-23 2018-02-21 李雨暹 Method and system for creating virtual message onto a moving object and searching the same
US10264207B2 (en) 2016-12-23 2019-04-16 Yu-Hsien Li Method and system for creating virtual message onto a moving object and searching the same
CN107222529A (en) * 2017-05-22 2017-09-29 北京邮电大学 Augmented reality processing method, WEB modules, terminal and cloud server
CN107748772A (en) * 2017-09-30 2018-03-02 深圳市谷熊网络科技有限公司 A kind of brand recognition method and device

Also Published As

Publication number Publication date
CN102194007B (en) 2014-12-10

Similar Documents

Publication Publication Date Title
US8331611B2 (en) Overlay information over video
US8661053B2 (en) Method and apparatus for enabling virtual tags
US8400548B2 (en) Synchronized, interactive augmented reality displays for multifunction devices
US6604049B2 (en) Spatial information using system, system for obtaining information, and server system
US9317133B2 (en) Method and apparatus for generating augmented reality content
CN101641948B (en) A mobile device with integrated photograph management system
CN101680766B (en) Image capturing device, additional information providing server, and additional information filtering system
KR102038856B1 (en) System and method for creating an environment and for sharing a location based experience in an environment
ES2558255T3 (en) Automated annotation of a view
US9424255B2 (en) Server-assisted object recognition and tracking for mobile devices
US9766089B2 (en) Method and apparatus for correlating and navigating between a live image and a prerecorded panoramic image
US8164599B1 (en) Systems and methods for collecting and providing map images
US8472664B1 (en) Inferring locations from an image
CN103635954B (en) Strengthen the system of viewdata stream based on geographical and visual information
KR20110066133A (en) Image annotation on portable devices
Tsou Integrated mobile GIS and wireless internet map servers for environmental monitoring and management
US20140098191A1 (en) Annotation method and apparatus
KR100651508B1 (en) Method for providing local information by augmented reality and local information service system therefor
US20080268876A1 (en) Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities
US8947421B2 (en) Method and server computer for generating map images for creating virtual spaces representing the real world
JP4322147B2 (en) Mobile terminal having map display function, map display system, information distribution server, and program
JP5871976B2 (en) Mobile imaging device as navigator
JP2010530998A (en) Image-based information retrieval method and system
KR20110039253A (en) Machine-readable representation of geographic information
US8903197B2 (en) Information providing method and apparatus, information display method and mobile terminal, program, and information providing

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model