CN103310099A - Method and system for realizing augmented reality by adopting image capture and recognition technology - Google Patents

Method and system for realizing augmented reality by adopting image capture and recognition technology Download PDF

Info

Publication number
CN103310099A
CN103310099A CN2013102089053A CN201310208905A CN103310099A CN 103310099 A CN103310099 A CN 103310099A CN 2013102089053 A CN2013102089053 A CN 2013102089053A CN 201310208905 A CN201310208905 A CN 201310208905A CN 103310099 A CN103310099 A CN 103310099A
Authority
CN
China
Prior art keywords
image
database
multimedia information
parameters
information
Prior art date
Application number
CN2013102089053A
Other languages
Chinese (zh)
Inventor
郑继威
张敏
罗乐生
Original Assignee
佛山电视台南海分台
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 佛山电视台南海分台 filed Critical 佛山电视台南海分台
Priority to CN2013102089053A priority Critical patent/CN103310099A/en
Publication of CN103310099A publication Critical patent/CN103310099A/en

Links

Abstract

The invention discloses a method and a system for realizing augmented reality by adopting image capture and recognition technology. The method comprises the following steps: A, obtaining a realistic image through image capture equipment; B, carrying out the recognition processing to the obtained image, obtaining parameters described the image characteristics, and carrying out querying and matching in a presupposed database by adopting the parameters; and C, obtaining a memory address of the multimedia information in the database relative to the parameters, and directly displaying the multimedia information obtained from the database or displaying the multimedia information obtained from the database after optimizing process. According to the method and the system for realizing augmented reality by adopting image capture and recognition technology, the following technical effects can be achieved: the users can obtain the required information more conveniently and intuitively or carry out more realistic user experience.

Description

一种利用图像捕获和识别技术实现增强现实的方法和系统 A method of using an image capture and recognition technology and augmented reality systems

技术领域 FIELD

[0001] 本发明涉及AR (Augmented Reality增强现实)技术领域,尤其涉及的是一种利用图像捕获和识别技术增强现实的方法和系统。 [0001] The present invention relates to AR (Augmented Reality Augmented Reality) technique, and in particular relates to a method and system for image capture and identification using augmented reality technologies.

背景技术 Background technique

[0002] 现实生活中,我们看到的各种物品(例如产品、海报、宣传画册等)展示的信息量和信息种类有限,用户需要了解更多关于物品相关的信息(视频、文字、图片、声音、模型等),就需要向相关的公司和人员索取相关的资料,或者去互联网上搜索该物品相关的资料,现有技术中的这种获取信息的方式非常不便,一方面不利于信息的推广传递和分享,另一方面在传递和分享信息的过程中不够直观明了,不利于用户接收了解。 [0002] In real life, we see various items (such as products, posters, publicity pictures, etc.) and the amount of information displayed is limited kind of information, users need to know more about the items related information (video, text, images, sound, models, etc.), we need to be obtained from the relevant companies and personnel-related information, or to search for relevant information on the items on the Internet, in the prior art in this way to get information is very inconvenient, on the one hand is not conducive to information promote the transfer and sharing, on the other hand in the process of transfer and sharing of information in simple and clear enough, is not conducive to the user to receive understanding.

[0003] 因此,现有技术还有待于改进和发展。 [0003] Thus, the prior art has yet to be improved and developed.

发明内容 SUMMARY

[0004] 本发明的目的在于提供一种利用图像捕获和识别技术增强现实的方法和系统,旨在解决现有技术中的获取信息的方式不够丰富,直观性较差等技术问题。 [0004] The object of the present invention to provide a method and system for image capture and identification using augmented reality technology, to solve the prior art rich enough access to information, and other technical problems less intuitive.

[0005] 本发明的技术方案如下:一种利用图像捕获和识别技术实现增强现实的方法,其中,包括以下步骤: [0005] aspect of the present invention is as follows: utilizing image capture and identification method of augmented reality technology, comprising the steps of:

A.通过图像捕捉设备获取现实的图像; A. Getting a realistic image by image capture device;

B.对获取到的图像进行识别处理,获取描述该图像特征的参数,并利用该参数在预设的数据库中进行查询匹配; B. of the acquired image recognition processing, the image acquisition parameters described features, and using the default parameters match the query in the database;

C.获取数据库中与该参数相对应的多媒体信息的存储地址,并将从存储地址获取的多媒体信息直接显示或进行优化处理后在现实图像中显示; C. After obtaining the storage address of the multimedia information database corresponding to the parameter, and displays the multimedia information directly acquired from the storage address or the display to optimize the real image;

所述步骤C中的多媒体信息的存储地址包括本地数据库的存储单元地址,或者云端存储地址,或者互联网网络地址; Said step of storing address information of the multimedia storage unit C includes an address of a local database, or cloud storage address, or an Internet network address;

所述预设的数据库中存储有描述不同类型图像的特征参数组信息,以及分别与每一个特征参数组对应的链接的多媒体信息的存储地址信息。 The database stores predetermined storage address information of the multimedia information described various types of image feature parameter set information, and respectively corresponding to each feature parameter set to the link.

[0006] 所述的利用图像捕获和识别技术实现增强现实的方法,其中,所述步骤B具体包括以下步骤: [0006] The use of image capture and identification method of augmented reality technology, wherein said step B includes the following steps:

B1.每一个具体的图像对应设置一组描述该图像的特征参数组,把这些特征参数组信息存储在预设的数据库中; . B1 each correspond to a specific image is provided a set of parameters characterizing the image, the feature parameters stored in the default group information database;

B2.对获取到的图像进行识别,得到描述该图像特征的参数,所述图像特征包括图像中的物品形状、颜色或线条; . B2 of the acquired images to identify, obtain parameters describe features of the image, the image including an image feature of the shape of the object, color or line;

B3.把B2中得到的参数与BI中数据库中定义的特征参数组进行匹配。 B3. The characteristic parameters and the parameters set in the database obtained BI B2 defined match.

[0007] 所述的利用图像捕获和识别技术实现增强现实的方法,其中,所述步骤C中的优化处理包括对多媒体信息进行压缩、更换背景或颜色。 Of [0007] using an image capture and identification method of augmented reality technology, wherein the optimization process includes the step C of the multimedia information is compressed, or changing the background color.

[0008] 所述的利用图像捕获和识别技术实现增强现实的方法,其中,对步骤C中显示后的多媒体信息进行交互操作。 Using an image capture and recognition technology [0008] The augmented reality implemented method, wherein the multimedia information is displayed in step C after interoperate.

[0009] 所述的利用图像捕获和识别技术实现增强现实的方法,其中,所述多媒体信息包括文字、图片、视频、音频、动画、模型和游戏。 Using an image capture and recognition technology [0009] The augmented reality implemented method, wherein the multimedia information including text, images, video, audio, animation, games and models.

[0010] 所述的利用图像捕获和识别技术实现增强现实的系统,其中,包括以下模块: 图像捕捉设备:用于即时获取现实图像; Using the image [0010] The capture and recognition technology augmented reality system, wherein the module comprises: an image capture device: for instant access to real image;

图像识别模块:对获取到的图像进行识别处理,获取描述该图像的参数; Image recognition module: for the acquired image recognition processing, the image acquisition parameters described;

输入模块:对显示后的多媒体信息进行交互操作; Input modules: multimedia information display interact;

数据库:存储描述不同类型图像的特征参数组信息,以及分别与每一个特征参数组对应的链接的多媒体信息的存储地址信息,同时存储部分多媒体信息; Database: stores the address information of the multimedia information description stored characteristic parameters of the image information of different types, and each respectively corresponding to the characteristic parameters of the link, while the portion of the multimedia information is stored;

数据处理模块:利用图像识别模块得到的参数在数据库中进行查询匹配,获取数据库中与该参数相对应的多媒体信息的存储地址,并将从存储地址获取的多媒体信息直接显示或进行优化处理后显示; Data processing module: after using the parameters obtained by the image recognition module matches the query in the database, obtaining the multimedia information stored in the address database corresponding to the parameter, and obtained from the storage address of the multimedia message directly displayed or the display to optimize ;

显示模块:显示多媒体信息或优化处理后的多媒体信息; The display module: Optimization of multimedia information or multimedia information processed;

所述图像捕捉设备分别与图像识别模块和显示模块通信连接,所述图像识别模块、输入模块、数据库和显示模块分别与数据处理模块通信连接。 The image capture device are connected to the image recognition module and the display module in communication with an image recognition module, an input module, a database, and a display module is connected with a data processing module in communication.

[0011] 所述的利用图像捕获和识别技术实现增强现实的系统,其中,所述数据库连接网络。 Using an image capture and recognition technology [0011] The implementation of augmented reality system, wherein the database connection network.

[0012] 所述的利用图像捕获和识别技术实现增强现实的系统,其中,所述图像捕捉设备持续捕捉图像,直到系统运行结束。 Using an image capture and recognition technology [0012] The implementation of augmented reality system, wherein the image capture device captures an image continued until the end of the run the system.

[0013] 本发明的有益效果:本发明通过图像捕捉设备捕获图像数据,利用图像识别模块分析图像数据。 [0013] Advantageous Effects of Invention: The present invention, image data captured by the image capturing device, analyzing image data by the image recognition module. 当图像数据与系统数据匹配之后,显示模块就会在现实场景中显示虚拟的图片、文字、视频、音频、动画或游戏等信息,用户只需要进行常规操作,即可进行人机交互,获取更多的信息和体验;本发明改变了传统的获取信息的方式,达到了用户更加方便、直观明了的获得想要的信息或者进行更加真实的用户体验的技术效果。 When the image data and the data matching system, virtual display module displays the information of images, text, video, audio, animation or other games in real-life scenarios, users only need to perform routine operations, to human-computer interaction, get more much information and experience; the invention changes the traditional way of access to information, to the user more convenient and intuitive information or to obtain the desired technical effects were more realistic user experience.

附图说明 BRIEF DESCRIPTION

[0014] 图1是本发明中的方法流程图。 [0014] FIG. 1 is a flowchart of a method of the present invention.

[0015] 图2是本发明中的步骤B的具体步骤流程图。 [0015] FIG 2 is a specific Step B in a flow chart of the present invention.

[0016] 图3是本发明中的系统的模块图。 [0016] FIG. 3 is a block diagram of a system according to the present invention.

具体实施方式 Detailed ways

[0017] 为使本发明的目的、技术方案及优点更加清楚、明确,以下参照附图并举实施例对本发明进一步详细说明。 [0017] To make the objectives, technical solutions and advantages of the present invention will become more apparent, clear embodiment of the present invention is described in more detail below with reference to the accompanying drawings.

[0018] 本发明公开了一种利用图像捕获和识别技术增强现实的方法,其方法流程如图1所示,包括以下步骤: [0018] The present invention discloses a method of image capture and identification using augmented reality technology, which flow of the method shown in Figure 1, comprising the steps of:

A.通过图像捕捉设备获取现实的图像; A. Getting a realistic image by image capture device;

B.对获取到的图像进行识别处理,获取描述该图像特征的参数,并利用该参数在预设的数据库中进行查询匹配; B. of the acquired image recognition processing, the image acquisition parameters described features, and using the default parameters match the query in the database;

C.获取数据库中与该参数相对应的多媒体信息的存储地址,并将从存储地址获取的多媒体信息直接显示或进行优化处理后在现实图像中显示; C. After obtaining the storage address of the multimedia information database corresponding to the parameter, and displays the multimedia information directly acquired from the storage address or the display to optimize the real image;

实际应用中,为了方便用户操作以及节约本地数据库的存储空间,所述多媒体信息存储在本体数据库中,或者存储在云端,或者存储在互联网上。 In practice, in order to facilitate user operation and save memory space in the local database, the multimedia information stored in the main database, or stored in the cloud, or stored on the Internet. 具体的,当多媒体信息的量较少,占据的存储空间不大时,可以优先选择储存在本地数据库中,当多媒体信息的量较多,占据的存储空间较大时,可以根据需要选择储存在云端,或者储存在互联网上。 Specifically, when a small amount of multimedia information, storage space when not occupied, preference can be stored in a local database, when a large amount of multimedia information, when the storage space occupied by the larger, can be selected according to need to be stored cloud, or stored on the Internet. 其中,所述步骤C中的多媒体信息的存储地址包括本地数据库的存储单元地址,或者云端存储地址,或者互联网网络地址。 Wherein the storage address of the multimedia information in the step C comprises storing unit address of the local database, or cloud storage address, or an Internet network address.

[0019] 其中,如图2所示,步骤B具体包括以下步骤: [0019] wherein, as shown in FIG. 2, step B comprises the steps of:

B1.每一个具体的图像对应设置一组描述该图像的特征参数组,把这些特征参数组信息存储在预设的数据库中; . B1 each correspond to a specific image is provided a set of parameters characterizing the image, the feature parameters stored in the default group information database;

B2.对获取到的图像进行识别,得到描述该图像特征的参数,所述图像特征包括图像中的物品形状、颜色或线条; . B2 of the acquired images to identify, obtain parameters describe features of the image, the image including an image feature of the shape of the object, color or line;

B3.把B2中得到的参数与BI中数据库中定义的特征参数组进行匹配。 B3. The characteristic parameters and the parameters set in the database obtained BI B2 defined match.

[0020] 具体的,多媒体信息可以为文字、图片、视频、音频、动画、模型、游戏等信息;其中,多媒体信息一般设置为用户想要了解的信息,例如与得到的图像相关的信息(包括文字、图片、视频、音频、动画、模型和游戏等信息),当这些相关的信息的量较小时,可以把这些相关的信息优先储存在本地数据库中,当这些相关的信息的量较大时,可以把这些相关的信息储存在云端或者互联网上,数据库中预先存储了多媒体信息的存储地址,并且多媒体信息的存储地址分别与特征参数组对应设置。 [0020] Specifically, the multimedia information can be information as text, pictures, video, audio, animation, models, games and so on; in which multimedia information is generally set information to a user wants to know, for example, related to the image obtained information (including text, images, video, audio, animation, games, and model information), when a small amount of information related to these, you can put these priorities relevant information is stored in a local database, when the amount of information related to these larger , information relating to these can be stored in the cloud or the Internet, the database stored in advance the address of the multimedia information is stored, and stores the address information of the multimedia, respectively provided corresponding to the feature parameter set.

[0021] 本发明还公开了实现本发明所述方法的系统,如图4所示,包括以下模块: [0021] The present invention also discloses a system implementing the method according to the present invention, shown in Figure 4, comprises the following modules:

图像捕捉设备:用于即时获取现实图像,如摄像头等; Image capture device: for instant access to real images, such as video cameras;

图像识别模块:对获取到的图像进行识别处理,获取描述该图像的参数; Image recognition module: for the acquired image recognition processing, the image acquisition parameters described;

输入模块:对显示后的多媒体信息进行交互操作,可以为语音输入模块,或者触屏文字(图案)输入模块; Input modules: multimedia information display interact, it may be voice input module, touch screen or text (pattern) input module;

数据库:存储描述不同类型图像的特征参数组信息,以及分别与每一个特征参数组对应的链接的多媒体信息的存储地址信息,同时存储部分多媒体信息; Database: stores the address information of the multimedia information description stored characteristic parameters of the image information of different types, and each respectively corresponding to the characteristic parameters of the link, while the portion of the multimedia information is stored;

数据处理模块:利用图像识别模块得到的参数在数据库中进行查询匹配,获取数据库中与该参数相对应的多媒体信息的存储地址,并将从存储地址获取的多媒体信息直接显示或进行优化处理后显示; Data processing module: after using the parameters obtained by the image recognition module matches the query in the database, obtaining the multimedia information stored in the address database corresponding to the parameter, and obtained from the storage address of the multimedia message directly displayed or the display to optimize ;

显示模块:显示多媒体信息或优化处理后的多媒体信息,具体可以为设备的显示屏;所述图像捕捉设备分别与图像识别模块和显示模块通信连接,所述图像识别模块、输入模块、数据库和显示模块分别与数据处理模块通信连接。 The display module: Optimization of multimedia information or multimedia information processing device may specifically be a display screen; respectively connected to the image capture device an image recognition module and the display module in communication with an image recognition module, an input module, a database, and a display module is connected with a data processing module in communication.

[0022] 本系统的工作过程如下:首先打开图像捕捉设备,捕捉现实中的图像(可以为某一物体、平面图案、立体场景等),图像捕捉设备得到图像后把图像以数据的形式传递给图像识别模块;图像识别模块开始识别图像,具体的,图像识别模块通过识别图像的颜色、图像中的物体的线条、形状、颜色、拍摄的角度等特征,得到描述该图像特征的参数,图像识别模块把这些参数传输给数据处理模块;数据处理模块接收到图像识别模块传输的参数后,把这些参数与数据库中已经定义的特征参数组进行匹配,匹配成功后,数据处理模块得到匹配成功的特征参数组对应设置的多媒体信息的存储地址信息,数据处理模块通过该地址信息把多媒体信息获取回来,直接显示到显示模块上,或者对多媒体信息进行优化处理后显示。 [0022] The operation of this system is as follows: First open the image capturing apparatus, an image capture reality (which may be an object, a planar pattern, three-dimensional scenes, etc.), the image capturing device to obtain an image transmitted to the image data in the form of the image recognition module; image recognition module identifying the start of an image, specifically, the image recognition module by a color identifying image, the image of the line object, shape, color, shot angle and other characteristics, to obtain the parameters describing the image feature, the image recognition module these parameters to the data processing module; data processing module, after receiving the parameter of the image recognition module transmission, the characteristic parameters of these parameters in the database has been defined to match, a match is found, the data processing module is matched successfully feature after displaying the address information of the multimedia information stored parameter set corresponding to the setting, the data processing module to the address information of the multimedia information obtaining back directly displayed on the display module, or to optimize the multimedia information. 在系统工作过程中,图像捕捉设备持续的对现实图形进行捕捉,直到系统运行结束。 In system operation, image capture device continued to reality graphics capture, until the end of the system is running.

[0023] 具体的,对多媒体信息的优化处理包括对多媒体信息进行压缩、更换背景或颜色。 [0023] Specifically, the optimization of the multimedia information comprises multimedia information compression, or changing the background color.

[0024] 实际应用中,本发明可以根据图像捕捉设备获得的现实图像中物体的线条、形状和颜色进行识别,也可以根据现实图像的颜色、特殊的标识、拍摄角度等特性进行识别;或者,本发明通过在现实画面中设置一些特定的参数点,每一个具体的现实画面对应一组特定的参数点,通过该参数点识别具体现实图像。 [0024] In a practical application, the present invention can be carried out according to the line, the shape and color of real image capture device obtained in the object recognition, it is possible according to the color reality image, specific identification, imaging characteristic angle of identification; or the present invention, by setting certain parameters in the real picture points, each corresponding to a specific picture of the reality of a particular set of parameter points, identified by the parameter specific reality image point. 本发明在识别图像捕捉设备获得的现实图像的过程中,采取模糊处理。 In the process of the present invention recognize reality image obtained image capture device, taken blurred. 本发明并不限定具体的图像识别方式,本发明的系统中同时设置有多种现实图像识别方式,实际应用中系统需要根据实际环境自动选择具体的现实图像识别方式。 The present invention is not limited to the specific embodiment of the image recognition system of the present invention is provided with a plurality of simultaneously reality image recognition mode, actual application system needs a specific reality image is automatically selected according to actual environment of identification.

[0025] 具体的,数据处理模块把多媒体信息直接调用显示到显示模块上,例如直接调用播放一段视频、音频等;或者对多媒体信息进行处理,把处理结果显示在显示模块上,例如在屏幕上显示一个可操作的图标,点开图标可以显示信息,或者当多媒体信息是游戏时,需要对现实捕捉得到的图像进行处理,把显示捕捉得到的图像以背景的形式叠加到游戏中 [0025] Specifically, the data processing module to the multimedia information call the display on the display module, such as a direct call playing a video, audio, etc.; or the multimedia information processing, the processing result displayed on the display module, for example, on a screen a display operable icon, opening the icon display information, or when the game is the multimedia information, the captured image of a real need to obtain processed, the resulting display the captured image is superimposed in the form of a game background

坐寸ο Sit inch ο

[0026] 具体的,输入模块可以为语音输入模块,或者触屏文字(图案)输入模块等,通过输入模块可以实现对显示的多媒体信息进行交互、控制或操作;例如可以通过触屏的方式拉动信息,对信息进行编辑,可以通过语音输入的方式播放音频、视频等,也可以通过语音输入或者触屏输入进行人机交互操作。 [0026] Specifically, the input module may be a voice input module, touch screen or text (pattern) input module, the input module may be implemented by the multimedia information displayed on the interactive control and operation; for example, be pulled by way of the touchscreen information, the information editing, you can play audio, video by means of voice input, etc., can also be human-computer interaction through speech input or touch screen input.

[0027] 实际应用中,本方法可以通过设置一个程序,安装在便携式设备上(例如手机、平板电脑、相机等具有摄像功能和显示功能的设备),通过程序实现各模块之间的数据传输,实现用户随时随地打开摄像头就可以了解更多的信息。 [0027] In practice, the present method can be provided by a program installed on the portable device (such as mobile phones, tablet computers, cameras and other equipment having an imaging function and a display function), data transmission between the modules by a program, users realize the camera can be opened at any time for more information.

[0028] 实施例1 [0028] Example 1

在数据库中事先对某一品牌的商标进行定义(在数据库中定义其特征参数组),并在数据库中存储一段介绍该品牌的信息(包括视频、音频、文字等),同时存储一个该品牌的官方网站IP地址信息,将这些多媒体信息的存储地址的信息与该商标的特征参数组对应设置。 A brand mark in advance in the database definition (defined further parameters in the database), and stores the brand introductory information (including video, audio, text, etc.) in the database, while storing the brand a the official website IP address information, the address information is stored multimedia information and characteristics of these parameters set the mark corresponding settings. 当用户利用设备的摄像头对准该商标时,捕捉得到该商标的图像,此时图像识别模块对图像进行识别,识别出描述该商标的参数并与数据库中定义的特征参数组进行匹配,匹配成功后,系统得到该商标对应设置的多媒体信息的存储地址,系统利用该存储地址把多媒体信息获取回来,在设备的显示屏幕上显示,用户可以选择播放关于该商标的视频、查看该商标的文字介绍等,同时用户可以通过预先存储的IP地址访问该商标的官方网站。 When the user equipment using the camera at the mark, to obtain the captured image of the mark, then the image recognition of the image recognition module recognizes that the parameters describing mark and matched to characteristic parameters defined in the database, the matching is successful , the system obtained storage address of the multimedia information of the mark provided corresponding to the system using the memory address to obtain back the multimedia information displayed on the display screen of the device, the user can choose to play the video on the mark, see the text of the mark presentation and so on, and users can visit the official website of the trademark by IP address stored in advance.

[0029] 实施例2 [0029] Example 2

在数据库中事先定义描述某一形状的物体的特征参数(比如具有四边形平面的物体,例如桌子、长方形瓷砖等),在数据库中存储一个小游戏,并且把该小游戏的存储地址与该特征参数对应设置,本实施例中,小游戏为篮球投篮游戏,当用户利用设备对一个具有四边形平面形状的物体进行拍摄时(例如对桌子进行拍摄),图像识别模块对图像进行识别,识别出描述该图像的参数,系统利用该参数与数据库中已经定义的特征参数组进行匹配,匹配成功后,得到与特征参数组对应设置的存储地址信息,系统利用该存储地址信息获取并运行篮球投篮游戏,其中游戏中的篮球场的背景为现实物体中的四边形平面,用户可以通过触屏输入模块进行小游戏体验。 Described previously defined in the database object of a shape characteristic parameter (such as an object having a quadrangular plane such as a table, a rectangular tile, etc.), a game is stored in the database, and stores the address of the game with the characteristic parameter provided corresponding to the present embodiment, the game of basketball shooting game (e.g., to a table to shoot), the image recognition module for image recognition when the user equipment to the object a quadrilateral planar shape having performed shooting, recognized the description of the the image parameters, the system using the characteristic parameters of the parameter in the database has been defined to match, a match is found, obtain the storage address information of the feature parameters corresponding to the group, the system will use the memory address information acquisition and run the basketball shooting games, wherein background basketball court game in a quadrangular plane real object, the user can experience the game through the touch screen input module.

[0030] 应当理解的是,本发明的应用不限于上述的举例,对本领域普通技术人员来说,可以根据上述说明加以改进或变换,所有这些改进和变换都应属于本发明所附权利要求的保护范围。 [0030] It should be appreciated that the present invention is applied is not limited to the above-described example, those of ordinary skill in the art, can be modified or converted according to the above description, all such modifications and variations shall fall within the appended claims of the invention protected range.

Claims (8)

1.一种利用图像捕获和识别技术实现增强现实的方法,其特征在于,包括以下步骤: A.通过图像捕捉设备获取现实的图像; B.对获取到的图像进行识别处理,获取描述该图像特征的参数,并利用该参数在预设的数据库中进行查询匹配; C.获取数据库中与该参数相对应的多媒体信息的存储地址,并将从存储地址获取的多媒体信息直接显示或进行优化处理后在现实图像中显示; 所述步骤C中的多媒体信息的存储地址包括本地数据库的存储单元地址,或者云端存储地址,或者互联网网络地址; 所述预设的数据库中存储有描述不同类型图像的特征参数组信息,以及分别与每一个特征参数组对应的链接的多媒体信息的存储地址信息。 An identification using image capture technology and method for augmented reality, characterized by comprising the steps of: A. acquiring real images by the image capturing device; B. on the acquired image recognition processing for a description of the image characteristic parameter, and using the default parameters match the query in the database; C. obtaining the storage address information of the multimedia database corresponding to the parameter, and obtained from the storage address of the multimedia information directly or optimized after displaying the real image; storage address of the multimedia information comprises the step C of the memory cell address of the local database, or cloud storage address, or an Internet network address; the predetermined database stores images of different types is described characteristic parameter set information, and storage address information of the multimedia information respectively corresponding to each feature parameter set to the link.
2.根据权利要求1所述的利用图像捕获和识别技术实现增强现实的方法,其特征在于,所述步骤B具体包括以下步骤: B1.每一个具体的图像对应设置一组描述该图像的特征参数组,把这些特征参数组信息存储在预设的数据库中; B2.对获取到的图像进行识别,得到描述该图像特征的参数,所述图像特征包括图像中的物品形状、颜色或线条; B3.把B2中得到的参数与BI中数据库中定义的特征参数组进行匹配。 2. The use of capture and image recognition technology according to claim 1 implemented method of augmented reality, wherein said step B includes the following steps:. B1 each correspond to a particular image feature of the image is provided to describe a set of parameters, the feature parameters stored in the default group information database;. B2 of the acquired images to identify, obtain parameters describe features of the image, the image including an image feature of the shape of the object, color or line; B3. the characteristic parameters and the parameters set in the database obtained BI B2 defined match.
3.根据权利要求2所述的利用图像捕获和识别技术实现增强现实的方法,其特征在于,所述步骤C中的优化处理包括对多媒体信息进行压缩、更换背景或颜色。 The capture and image recognition technology using the augmented reality 2-implemented method as claimed in claim, wherein the optimization process includes the step C of the multimedia information is compressed, or changing the background color.
4.根据权利要求2所述的利用图像捕获和识别技术实现增强现实的方法,其特征在于,对步骤C中显示后的多媒体信息进行交互操作。 The capture and image recognition technology using the augmented reality 2-implemented method as claimed in claim, wherein the multimedia information is displayed in Step C interoperate.
5.根据权利要求2所述的利用图像捕获和识别技术实现增强现实的方法,其特征在于,所述多媒体信息包括文字、图片、视频、音频、动画、模型和游戏。 5. The method implemented using augmented reality according to an image capturing and recognition according to claim 2, wherein the multimedia information including text, images, video, audio, animation, games and models.
6.一种实现权利要求1-5任意一项所述的利用图像捕获和识别技术实现增强现实的系统,其特征在于,包括以下模块: 图像捕捉设备:用于即时获取现实图像; 图像识别模块:对获取到的图像进行识别处理,获取描述该图像的参数; 输入模块:对显示后的多媒体信息进行交互操作; 数据库:存储描述不同类型图像的特征参数组信息,以及分别与每一个特征参数组对应的链接的多媒体信息的存储地址信息,同时存储部分多媒体信息; 数据处理模块:利用图像识别模块得到的参数在数据库中进行查询匹配,获取数据库中与该参数相对应的多媒体信息的存储地址,并将从存储地址获取的多媒体信息直接显示或进行优化处理后显示; 显示模块:显示多媒体信息或优化处理后的多媒体信息; 所述图像捕捉设备分别与图像识别模块和显示模块通信连接,所述图像识别模 An implement according to any one of claims 1-5 using the image capture and recognition technology augmented reality system comprising the following modules: an image capture device: for instant access to real image; an image recognition module : the acquired image recognition processing, obtaining parameters describing the image; input module: multimedia information display interact; database: characteristic parameter set information storing different types of images described, respectively, and the parameters associated with each feature storing address information of the multimedia information corresponding to the group link, while storing portion of the multimedia information; data processing module: using an image recognition module obtained parameters match the query in the database, obtaining the storage address database the parameters corresponding to the multimedia information after the display, and the display, or to optimize the multimedia information directly acquired from the memory address; a display module: displaying the multimedia information or multimedia information to optimize the processing; the image capture device are image recognition module and the display module in communication with the connection, the said image recognition module 块、输入模块、数据库和显示模块分别与数据处理模块通信连接。 Block, an input module, a database, and a display module is connected with a data processing module in communication.
7.根据权利要求6所述的利用图像捕获和识别技术实现增强现实的系统,其特征在于,所述数据库连接网络。 7. The use of claim 6 image capture and identification technology claim augmented reality system, wherein said network database is connected.
8.根据权利要求7所述的利用图像捕获和识别技术实现增强现实的系统,其特征在于,所述图像捕捉设备持续捕捉图像,直到系统运行结束。 According to claim recognition technology using the image capture and 7 to achieve augmented reality system, wherein the image capture device captures an image continuously, until the end of system operation.
CN2013102089053A 2013-05-30 2013-05-30 Method and system for realizing augmented reality by adopting image capture and recognition technology CN103310099A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013102089053A CN103310099A (en) 2013-05-30 2013-05-30 Method and system for realizing augmented reality by adopting image capture and recognition technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013102089053A CN103310099A (en) 2013-05-30 2013-05-30 Method and system for realizing augmented reality by adopting image capture and recognition technology

Publications (1)

Publication Number Publication Date
CN103310099A true CN103310099A (en) 2013-09-18

Family

ID=49135309

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013102089053A CN103310099A (en) 2013-05-30 2013-05-30 Method and system for realizing augmented reality by adopting image capture and recognition technology

Country Status (1)

Country Link
CN (1) CN103310099A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104090928A (en) * 2014-06-23 2014-10-08 吕志雪 Data processing method and system
CN104216951A (en) * 2014-08-15 2014-12-17 广州金山网络科技有限公司 Method for realizing augmented reality based on mobile terminal and mobile terminal
CN104461318A (en) * 2013-12-10 2015-03-25 苏州梦想人软件科技有限公司 Touch read method and system based on augmented reality technology
CN104461215A (en) * 2014-11-12 2015-03-25 深圳市东信时代信息技术有限公司 Augmented reality system and method based on virtual augmentation technology
CN104485052A (en) * 2014-12-10 2015-04-01 福建省纳金网信息技术有限公司 Product demonstration method and system based on mobile terminal
CN105095850A (en) * 2014-05-13 2015-11-25 林纪忠 Smart community augmented reality system
CN105338117A (en) * 2015-11-27 2016-02-17 亮风台(上海)信息科技有限公司 Method, device and system for generating AR applications and presenting AR instances
CN105353878A (en) * 2015-11-10 2016-02-24 华勤通讯技术有限公司 Augmented reality information processing method, device and system
CN105830095A (en) * 2016-03-21 2016-08-03 香港应用科技研究院有限公司 Level and advice for selecting augmented reality marks
CN105915879A (en) * 2016-04-14 2016-08-31 京东方科技集团股份有限公司 Video display method, and head-mounted display device and system
CN105930835A (en) * 2016-04-13 2016-09-07 无锡东游华旅文化传媒有限公司 Enhanced image identification system and method
CN106055708A (en) * 2016-06-28 2016-10-26 广东欧珀移动通信有限公司 Picture generation and display method and device, and terminal equipment
CN106097794A (en) * 2016-07-25 2016-11-09 焦点科技股份有限公司 The Chinese phonetic alphabet based on augmented reality combination is recognized reading learning system and recognizes reading method
CN106156708A (en) * 2015-04-15 2016-11-23 北京赛伯传奇科技有限公司 Precise image identification system
CN106462648A (en) * 2014-07-11 2017-02-22 英特尔公司 Dynamic control for data capture
WO2017167032A1 (en) * 2016-03-29 2017-10-05 腾讯科技(深圳)有限公司 Target object displaying method and device
CN107583276A (en) * 2016-07-07 2018-01-16 深圳狗尾草智能科技有限公司 Game parameter control method, device and game control method, device
WO2019100936A1 (en) * 2017-11-23 2019-05-31 腾讯科技(深圳)有限公司 Image processing method, electronic device and storage medium
US10496694B2 (en) 2016-03-21 2019-12-03 Hong Kong Applied Science and Technology Research Institute Company Limited Rating and advising for selection of augmented reality markers

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040077393A1 (en) * 2002-10-17 2004-04-22 Kim Ju Wan Apparatus and method for video based shooting game
CN1588429A (en) * 2004-08-06 2005-03-02 上海大学 Automatic identifying method for skin micro imiage symptom
US20060287748A1 (en) * 2000-01-28 2006-12-21 Leonard Layton Sonic landscape system
CN101189049A (en) * 2005-04-06 2008-05-28 苏黎士高等院校非金属材料联盟 Method of executing an application in a mobile device
CN101510934A (en) * 2009-03-20 2009-08-19 北京中星微电子有限公司 Digital plate frame and method for displaying photo
CN101553752A (en) * 2005-04-22 2009-10-07 Ydreams信息有限公司 System for the visualization of information superimposed upon real images

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060287748A1 (en) * 2000-01-28 2006-12-21 Leonard Layton Sonic landscape system
US20040077393A1 (en) * 2002-10-17 2004-04-22 Kim Ju Wan Apparatus and method for video based shooting game
CN1588429A (en) * 2004-08-06 2005-03-02 上海大学 Automatic identifying method for skin micro imiage symptom
CN101189049A (en) * 2005-04-06 2008-05-28 苏黎士高等院校非金属材料联盟 Method of executing an application in a mobile device
CN101553752A (en) * 2005-04-22 2009-10-07 Ydreams信息有限公司 System for the visualization of information superimposed upon real images
CN101510934A (en) * 2009-03-20 2009-08-19 北京中星微电子有限公司 Digital plate frame and method for displaying photo

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104461318A (en) * 2013-12-10 2015-03-25 苏州梦想人软件科技有限公司 Touch read method and system based on augmented reality technology
CN105095850A (en) * 2014-05-13 2015-11-25 林纪忠 Smart community augmented reality system
CN104090928A (en) * 2014-06-23 2014-10-08 吕志雪 Data processing method and system
CN106462648A (en) * 2014-07-11 2017-02-22 英特尔公司 Dynamic control for data capture
CN104216951A (en) * 2014-08-15 2014-12-17 广州金山网络科技有限公司 Method for realizing augmented reality based on mobile terminal and mobile terminal
CN104216951B (en) * 2014-08-15 2018-02-02 广州金山网络科技有限公司 A kind of method and mobile terminal that augmented reality is realized based on mobile terminal
CN104461215A (en) * 2014-11-12 2015-03-25 深圳市东信时代信息技术有限公司 Augmented reality system and method based on virtual augmentation technology
CN104485052A (en) * 2014-12-10 2015-04-01 福建省纳金网信息技术有限公司 Product demonstration method and system based on mobile terminal
CN104485052B (en) * 2014-12-10 2019-08-09 福建省纳金网信息技术有限公司 A kind of product demonstration method and system based on mobile terminal
CN106156708A (en) * 2015-04-15 2016-11-23 北京赛伯传奇科技有限公司 Precise image identification system
CN105353878A (en) * 2015-11-10 2016-02-24 华勤通讯技术有限公司 Augmented reality information processing method, device and system
CN105338117A (en) * 2015-11-27 2016-02-17 亮风台(上海)信息科技有限公司 Method, device and system for generating AR applications and presenting AR instances
CN105338117B (en) * 2015-11-27 2018-05-29 亮风台(上海)信息科技有限公司 For generating AR applications and method, equipment and the system of AR examples being presented
WO2017088777A1 (en) * 2015-11-27 2017-06-01 亮风台(上海)信息科技有限公司 Method, device and system for generating ar application and presenting ar instance
CN105830095B (en) * 2016-03-21 2019-03-01 香港应用科技研究院有限公司 Grading and suggestion for selective enhancement real marker
CN105830095A (en) * 2016-03-21 2016-08-03 香港应用科技研究院有限公司 Level and advice for selecting augmented reality marks
US10496694B2 (en) 2016-03-21 2019-12-03 Hong Kong Applied Science and Technology Research Institute Company Limited Rating and advising for selection of augmented reality markers
WO2017167032A1 (en) * 2016-03-29 2017-10-05 腾讯科技(深圳)有限公司 Target object displaying method and device
CN105930835A (en) * 2016-04-13 2016-09-07 无锡东游华旅文化传媒有限公司 Enhanced image identification system and method
CN105930835B (en) * 2016-04-13 2019-04-02 无锡东游华旅网络科技有限公司 Enhanced image identifying system and method
CN105915879B (en) * 2016-04-14 2018-07-10 京东方科技集团股份有限公司 A kind of image display method, head-mounted display apparatus and system
CN105915879A (en) * 2016-04-14 2016-08-31 京东方科技集团股份有限公司 Video display method, and head-mounted display device and system
CN106055708A (en) * 2016-06-28 2016-10-26 广东欧珀移动通信有限公司 Picture generation and display method and device, and terminal equipment
CN107583276A (en) * 2016-07-07 2018-01-16 深圳狗尾草智能科技有限公司 Game parameter control method, device and game control method, device
CN106097794A (en) * 2016-07-25 2016-11-09 焦点科技股份有限公司 The Chinese phonetic alphabet based on augmented reality combination is recognized reading learning system and recognizes reading method
WO2019100936A1 (en) * 2017-11-23 2019-05-31 腾讯科技(深圳)有限公司 Image processing method, electronic device and storage medium

Similar Documents

Publication Publication Date Title
ES2611336T3 (en) Portable augmented reality presentation device and method
US8965271B1 (en) Method and mechanism for coordinated capture and organization of multimedia data
CN102595228B (en) content synchronization apparatus and method
US8661053B2 (en) Method and apparatus for enabling virtual tags
US20160094886A1 (en) Data Presentation Method, Terminal, and System
US9767768B2 (en) Automated object selection and placement for augmented reality
US9584766B2 (en) Integrated interactive space
RU2614137C2 (en) Method and apparatus for obtaining information
US9241184B2 (en) Clothing visualization
CN104603719A (en) Augmented reality surface displaying
JP6349031B2 (en) Method and apparatus for recognition and verification of objects represented in images
CN103997688A (en) Intelligent interaction system, intelligent interaction device and intelligent interaction method
CN102821323A (en) Video playing method, video playing system and mobile terminal based on augmented reality technique
CN103220490A (en) Special effect implementation method in video communication and video user terminal
US9158389B1 (en) Virtualization of tangible interface objects
KR101101090B1 (en) Creation of game-based scenes
US9055189B2 (en) Virtual circular conferencing experience using unified communication technology
KR101874895B1 (en) Method for providing augmented reality and terminal supporting the same
CN104134229A (en) Real-time interaction reality augmenting system and method
CN103916711A (en) Method and device for playing video signals
CN104125508A (en) Video sharing method and terminal
CN102800065A (en) Augmented reality equipment and method based on two-dimensional code identification and tracking
US10033967B2 (en) System and method for interactive video conferencing
EP3166079A1 (en) Augmented reality method and system based on wearable device
CN103679204A (en) Image identification and creation application system and method based on intelligent mobile device platform

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
RJ01