CN103632626A - Intelligent tour guide realizing method and intelligent tour guide device based on mobile network and mobile client - Google Patents

Intelligent tour guide realizing method and intelligent tour guide device based on mobile network and mobile client Download PDF

Info

Publication number
CN103632626A
CN103632626A CN201310652180.7A CN201310652180A CN103632626A CN 103632626 A CN103632626 A CN 103632626A CN 201310652180 A CN201310652180 A CN 201310652180A CN 103632626 A CN103632626 A CN 103632626A
Authority
CN
China
Prior art keywords
sight spot
guide
mobile
mobile terminal
service device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310652180.7A
Other languages
Chinese (zh)
Other versions
CN103632626B (en
Inventor
黄文培
许源源
刘营
汪体勇
任宜东
鞠汶成
贾明正
王俊睿
孟宪伟
周昌贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SICHUAN INSTITUTE OF COMPUTER SCIENCES
Original Assignee
SICHUAN INSTITUTE OF COMPUTER SCIENCES
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SICHUAN INSTITUTE OF COMPUTER SCIENCES filed Critical SICHUAN INSTITUTE OF COMPUTER SCIENCES
Priority to CN201310652180.7A priority Critical patent/CN103632626B/en
Publication of CN103632626A publication Critical patent/CN103632626A/en
Application granted granted Critical
Publication of CN103632626B publication Critical patent/CN103632626B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses an intelligent tour guide realizing method based on a mobile network, an intelligent tour guide device based on the mobile network and a mobile client, and relates to the field of smart tourism under a mobile network environment. The invention has the technical point that the intelligent tour guide realizing method comprises the steps of step 1, storing scenery spot tourism information resources corresponding to each scenery spot ID (Identification) in a storage zone of a tour guide server; step 2, collecting scenery spot location information by a mobile terminal, and then transmitting the scenery spot location information to the tour guide server through the mobile network; step 3, extracting a scenery spot ID in the scenery spot location information by the tour guide server, and finding a scenery spot tourism information resource corresponding to the scenery spot ID in the storage zone; step 4, pushing the scenery spot tourism information resource corresponding to the scenery spot ID to the mobile terminal through the mobile network by the tour guide server; steps 5, presenting the scenery spot tourism information resource to a user by the mobile terminal, and so on.

Description

A kind of intelligent guide implementation method, device and mobile client based on mobile Internet
Technical field
The present invention relates to the wisdom tour field under mobile internet environment.
Background technology
Guide guides visit, and its effect is to make visitor fully experience the places of cultural interest of tourist attractions, solves the problem that visitor runs in tourism simultaneously.Scenic spot guide mainly comprises artificial and two kinds of means of electronics at present.
Artificial guide has inherent advantage aspect the specific aim of explanation mode and dirigibility, can be in conjunction with weather, season, visitor's mood, for the visitor of Different education levels, esthetic sentiment, select different tour guide speeches.Yet, the individual factor of being conducted a sightseeing tour, the impact of aspects such as ability to express, the scope of one's knowledge, professionalism, individual's mastery, the problem such as the ubiquity service fee of manually conducting a sightseeing tour is high, service quality is unstable.In the tourist season, due to the restriction of human resources, supply falls short of demand especially for the especially high-caliber foreign language guide of artificial guide.
In order to improve capacity and the service level at scenic spot, from the nineties in last century, electronic guide technical research has generally been carried out in countries in the world.So-called electronic guide refers to electronic technology, the produced various guide interpreting equipment of signal processing technology of utilizing.The portable electronic omniselector that for example a company of Massachusetts, United States invents, it has stored more than 30,000 tour guide informations such as U.S. local tour company, sight spot, restaurant, hospital, refuelling station, can be for visitor provides travel-line planning, navigation of electronic map service.At home, 2005, the Temple of Heaven took the lead in having adopted intelligent electronic guide system.Comprise that at present a plurality of sight spots such as the Forbidden City, the Summer Palace, Beihai park, Museum of Tianjin, Laoshan scenic spot have all introduced electronic guide system.
All in all, on current electronic guide system, there are the following problems:
1, the data of conventional portable electronic guide device are stored in terminating machine, and its memory capacity and handling property have directly affected the application of itself, and Data Update is inconvenient, often there will be the out-of-date phenomenon of data.
2, in order to realize the induction at sight spot and accurate location, the hand-held guide equipment of specialty needs customization, not only expensive, and easily damage, management of leasing difficulty.
3, most electronic guide product is still operating as master with button player and touch screen type, and every sight spot need click corresponding button and just can hear that sight spot introduces word.In essence, this type systematic is exactly an audio player.Its advantage is reliable and stable, shortcoming be need user to operate to intervene more, interactivity and poor user experience.Although portioned product has been introduced Mobile Location Technology, yet because base station, gps signal are easily interfered, positioning precision and reliability are not high, the problems such as mobile terminal power consumption is large, traditional mobile phone electronic guide system still can not be realized well sight spot location sensitive-> triggering-> tour guide information and play.
Summary of the invention
Technical matters to be solved by this invention is: for the problem of above-mentioned existence, provide a kind of low cost, accurate positioning, abundant intelligent guide implementation method, device and the mobile client based on mobile Internet of sight spot Tourism Information Resources.
The intelligent guide implementation method based on mobile Internet in the present invention comprises:
Step 1: sight spot Tourism Information Resources corresponding to each sight spot ID stored in the memory block of guide service device;
Step 2: mobile terminal gathers sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device;
Step 3: guide service device extracts in the ID, memory block, sight spot in the locating information of sight spot and searches the sight spot Tourism Information Resources that this sight spot ID is corresponding;
Step 4: guide service device is pushed to described mobile terminal by sight spot Tourism Information Resources corresponding to described sight spot ID by mobile network;
Step 5: described mobile terminal is presented to user by sight spot Tourism Information Resources.
Preferably, described sight spot Tourism Information Resources comprises sight spot character introduction, sight spot picture, sight spot commentary and sight spot animation; And
The document that sight spot character introduction is converted to PDF is stored in described memory block;
The file that sight spot picture is converted to jpeg format is stored in described memory block;
The file that sight spot commentary is converted to MP4 form is stored in described memory block;
The animation file that is swf form by sight spot animated transition is stored in described memory block.
Preferably, described sight spot locating information is sight spot voice signal, sight spot Quick Response Code, sight spot photo or sight spot GPS information.
Preferably, in step 3, the step of extracting sight spot ID from sight spot photo further comprises:
Sight spot photo is carried out to pre-service;
Pretreated sight spot photo is carried out to feature extraction;
Described feature is mated with the picture in sight spot picture database on guide service device, obtain sight spot ID.
Preferably, in step 3, from the step of GPS information extraction sight spot, sight spot ID, further comprise:
The latitude and longitude coordinates of taking out one by one each sight spot ID in sight spot latitude and longitude coordinates database from guide service device;
Calculate distance between latitude and longitude coordinates in the GPS information of described sight spot and the latitude and longitude coordinates of described sight spot ID;
If described distance within the scope of the error of calculation, is returned to described sight spot ID; Otherwise locate unsuccessfully at sight spot.
Preferably, described step 2 also comprises: mobile terminal is taken pictures by the tourist attractions at user place or capture video obtains real scene, then by mobile network, is transferred to guide service device;
Described step 3 also comprises: described real scene is carried out to registration; From guide service device, in virtual scene storehouse, extract virtual scene figure; According to the result of registration, described virtual scene and real scene are merged to the image after being merged;
Described step 4 also comprises: guide service device is pushed to described mobile terminal by the image after described fusion by mobile network;
Described step 5 also comprises: described mobile terminal is presented to user by the image after merging.
A kind of intelligent tour guide device based on mobile Internet provided by the invention, comprises mobile client module and guide service module;
Described mobile client module is installed on mobile terminal, for controlling mobile terminal, gathers sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device; And control mobile terminal presents to user the sight spot Tourism Information Resources that tourist service module pushes;
Described tourist service module is installed on guide service device, for sight spot Tourism Information Resources corresponding to each sight spot ID being stored into the memory block of guide service device; Extract in the ID, memory block, sight spot in the locating information of sight spot and search the sight spot Tourism Information Resources that this sight spot ID is corresponding; And sight spot Tourism Information Resources corresponding to described sight spot ID is pushed to described mobile terminal by mobile network.
The present invention also provides the mobile client in a kind of intelligent tour guide device based on mobile Internet, described mobile client is installed on mobile terminal, be used for controlling mobile terminal and gather sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device; And control mobile terminal presents to user the sight spot Tourism Information Resources that tourist service device pushes.
In sum, owing to having adopted technique scheme, the invention has the beneficial effects as follows:
1, traditional standalone version portable electronic guide device, its memory card capacity limited (1~5GB).The present invention adopts cloud memory technology, and the sight spot tourist resources memory capacity of system can be very large, in theory not restriction;
2, adopt mobile Internet to realize propelling movement and the broadcasting of tour guide information, not only simplified the installation of terminal software, and the renewal of tour guide information is quick and easy;
3, the architecture of mobile phone, GPS locate at present, and its positional precision is generally more than 3 meters.The present invention adopts the location algorithm of taking pictures based on image recognition, and its sight spot positioning precision can reach in 1 meter;
4, compare with traditional multimedia guide's explanation, the present invention proposes augmented reality three-dimensional guidance method and can greatly improve visitor in the space-time impression at sight spot and experience;
5, mobile client module of the present invention can be arranged on smart mobile phone, computer, and can take smart mobile phone or individual panel computer is terminal, replaces special-purpose mobile guide's equipment, its operation, uses easylier, and greatly reduces costs.
Accompanying drawing explanation
Examples of the present invention will be described by way of reference to the accompanying drawings, wherein:
Fig. 1 is general structure block diagram of the present invention.
Fig. 2 is the structured flowchart of a specific embodiment of guide service device of the present invention.
Fig. 3 is the process flow diagram that the present invention extracts a specific embodiment of sight spot ID method.
Fig. 4 for extracting the process flow diagram of sight spot ID from the voice of sight spot.
Fig. 5 for extracting the process flow diagram of sight spot ID from the Quick Response Code of sight spot.
Fig. 6 for extracting the process flow diagram of sight spot ID from the picture of sight spot.
Fig. 7 is the process flow diagram of augmented reality three-dimensional guidance method.
Fig. 8 is the conversion schematic diagram that mark coordinate is tied to camera coordinate system.
Fig. 9 is that skew schematic diagram occurs the center origin of imaging plane on the plane of delineation.
Figure 10 is the plane of delineation schematic diagram that is distorted.
Embodiment
Disclosed all features in this instructions, or the step in disclosed all methods or process, except mutually exclusive feature and/or step, all can combine by any way.
Disclosed arbitrary feature in this instructions, unless narration especially all can be replaced by other equivalences or the alternative features with similar object.That is,, unless narration especially, each feature is an example in a series of equivalences or similar characteristics.
As Fig. 1, the intelligent tour guide device based on mobile Internet in the present invention, comprises mobile client module and guide service module;
Described mobile client module is installed on mobile terminal, on smart mobile phone, notebook computer and panel computer, be used for controlling mobile terminal and gather sight spot locating information, then pass through mobile network, as 3G wireless network or wifi wireless network, described sight spot locating information is transferred to guide service device; And control mobile terminal presents to user the sight spot Tourism Information Resources that tourist service module pushes;
Described tourist service module is installed on guide service device, can be called again mobile guide's cloud service platform, for sight spot Tourism Information Resources corresponding to each sight spot ID being stored into the memory block of guide service device; Extract in the ID, memory block, sight spot in the locating information of sight spot and search the sight spot Tourism Information Resources that this sight spot ID is corresponding; And sight spot Tourism Information Resources corresponding to described sight spot ID is pushed to described mobile terminal by mobile network.
The method that said apparatus is realized intelligent guide comprises:
Step 1: sight spot Tourism Information Resources corresponding to each sight spot ID stored in the memory block of guide service device;
Step 2: mobile terminal gathers sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device;
Step 3: guide service device extracts in the ID, memory block, sight spot in the locating information of sight spot and searches the sight spot Tourism Information Resources that this sight spot ID is corresponding;
Step 4: guide service device is pushed to described mobile terminal by sight spot Tourism Information Resources corresponding to described sight spot ID by mobile network;
Step 5: described mobile terminal is presented to user by sight spot Tourism Information Resources.
In one embodiment, sight spot Tourism Information Resources comprises sight spot character introduction, sight spot picture, sight spot commentary and sight spot animation.As Fig. 2, sight spot character introduction unification is converted to the document of PDF, sight spot picture is converted to the file of jpeg format, sight spot commentary is converted to the file of MP4 form simultaneously.If there is animation at sight spot, need to be ready in advance the animation file of swf form.Preprepared sight spot Tourism Information Resources (document of PDF, JPEG picture, MP4 video, swf animation) is uploaded to mobile guide service device, is stored in its memory block.Above-mentioned each sight spot Tourism Information Resources is corresponding with sight spot ID.
In another embodiment, described sight spot locating information can be sight spot voice signal, sight spot Quick Response Code, sight spot photo or sight spot GPS information.Mobile terminal is scanned, is taken pictures by phonetic entry, Quick Response Code and GPS locates merit various dimensions collection visitor at the scene information at sight spot, and sends in real time on long-range guide service device by 3G, WIFI.
As Fig. 3, the concrete mode that guide service device extracts sight spot ID is such:
Does is the sight spot locating information that first judgement is received sight spot voice signal? if call speech-recognition services, extract sight spot title, by data base querying, obtain sight spot ID, as Fig. 4.
Does is the sight spot locating information that judgement is received sight spot Quick Response Code if not sight spot voice signal? if start Quick Response Code inquiry service, inquiry visitor place sight spot ID, as Fig. 5.
Does is the sight spot locating information that judgement is received sight spot photo if not sight spot Quick Response Code? if use framing algorithm, extract the ID at sight spot, visitor place, as Fig. 6.
Does is the sight spot locating information that judgement is received sight spot GPS information if not sight spot photo? if calling station inquiry service, extracts visitor place sight spot ID.
As Fig. 6, an embodiment of sight spot framing is such: first sight spot photo is carried out to pre-service, image pretreatment mode can be cut apart for normalized, smoothing denoising, image based on rim detection, by rim detection, scenery is separated from background etc.; Then extract feature, characteristics of image can be grey level histogram, form factor and bending moment etc. not; Finally characteristics of image is mated with sight spot object of reference picture pre-stored in database, finally export sight spot ID.
If scenic spot, visitor place can receive network and gps signal, the latitude and longitude information that mobile terminal just can Real-time Obtaining visitor, or be called sight spot GPS information.Method by GPS information extraction sight spot, sight spot ID is as follows:
If, the longitude and latitude of certain sight spot ID is (LonA, LatA), longitude and latitude (the LonB of the current position of visitor B, LatB), according to the benchmark of 0 degree warp, east longitude degree of learning from else's experience on the occasion of (Longitude), west longitude degree of learning from else's experience negative value (Longitude), north latitude is got 90-latitude value (90-Latitude), and south latitude is got 90+ latitude value (90+Latitude), and 2 after above-mentioned processing are counted (MLonA, MLatA) and (MLonB, MLatB).According to triangle, derive, the computing formula that can obtain 2 distances is as follows:
C=sin(MLatA)*sin(MLatB)*cos(MLonA-MLonB)+cos(MLatA)*cos(MLatB)
Distance=R*Arccos (C) * Pi/180, the mean radius that wherein R is the earth (R=6371.004 km).
For example, if the distance B istance at visitor and this sight spot in the error of calculation (5 meters or 10 meters) scope, returns to location, sight spot success message.Otherwise locate unsuccessfully at sight spot.
The present invention also provides a kind of intelligent guide implementation method that can augmented reality, augmented reality (Augmented Reality, abbreviation AR) technology is to pass through computer technology, virtual scene is embedded in real scene, real scene and virtual scene are superimposed upon in same picture or space in real time, thereby realize the harmonious coexistence of virtual world and real world.Augmented reality is an important branch of virtual reality technology, is characterized in consistance combination and the real-time, interactive in actual situation space.
As Fig. 7, augmented reality virtual guide methods based on mobile terminal is on aforesaid embodiment basis, described step 2 also comprises: mobile terminal is taken pictures by the tourist attractions at user place or capture video obtains real scene, then by mobile network, is transferred to guide service device;
Described step 3 also comprises: described real scene is carried out to registration; Augmented reality system must detect observer's (or mobile terminal camera) in real time with respect to position and the deflection of real scene, and the inner parameter of imaging system (camera) (focal length and pixel depth-width ratio etc.), to can determine in real time the virtual scene that will the add mapping position in real space according to these information, and these information are presented to the tram in image in real time.In the view of user, no matter from any angle, observe, dummy object and real scene all should keep the geometry consistance of three dimensional euclidean space, the task that registration module that Here it is will complete.
Step 3 also comprises extracts virtual scene figure from guide service device in virtual scene storehouse, be called again scene and generate.Scene generates and is responsible for the virtual scene figure that augmented reality system provides tourist attractions.Here, we first for specific tourist attractions, to use 3DS(3DS be a kind of 3 d modeling software instrument) set up its three-dimensional virtual scene storehouse.Subsequently, according to the residing position of visitor and state, real-time loading virtual scene from virtual scene storehouse.
Step 3 also comprises that actual situation scene is synthetic, on the virtual display platform of OSG, according to the result of registration, described virtual scene and real scene is merged to the image after being merged;
Described step 4 also comprises: guide service device is pushed to described mobile terminal by the image after described fusion by mobile network;
Described step 5 also comprises: described mobile terminal is presented to user by the image after merging.
Above-mentioned registration, scene generate and the synthetic prior art that is of actual situation scene.
Registration mainly includes monumented point and two kinds of methods of no marks point tracking registration at present.Although the artificial registration algorithm that has a monumented point is comparative maturity, perfect; but owing to need to adding in tourist quarters the monumented point of various shapes, color; this is unallowed at a lot of national protections scenic spot, so the present invention adopts based on natural mark registration algorithm.
The basic step of this algorithm is as follows:
1) obtain the width real scene picture that mobile terminal is taken, or intercept a frame real scene image from mobile terminal capture video stream, and by its thing as a token of;
2) use image recognition algorithm extract minutiae from mark image:
At present, a lot of for the image recognition algorithm of extract minutiae, the present invention adopts SURF algorithm to extract scene features point.At present, in image characteristic point extraction algorithm, SIFT algorithm is considered to effective, the most the most frequently used algorithm.But if not by means of hardware-accelerated and dedicated graphics processors, SIFT algorithm is difficult to reach the requirement of real-time processing.As a simple implementation of SIFT algorithm, SURF algorithm has improved 3 times in arithmetic speed, has met the feature point detection of yardstick and rotational invariance simultaneously.
3) complement mark article coordinate is tied to the conversion of camera coordinate system:
As Fig. 8, establish, R is rotation matrix, and T is translation vector, and O is that numerical value is all zero vector, mark coordinate system (x m, y m, z m) tto camera coordinate system (x c, y c, z c) tmatrixing can be expressed as:
x c y c z c 1 = R T O 1 x m y m z m 1 = r 1 r 2 r 3 t 1 r 4 r 5 r 6 t 2 r 7 r 8 r 9 t 3 0 0 0 1 x m y m z m 1
4) complete the conversion that camera coordinates is tied to actual sights image coordinate system:
Suppose that mobile terminal camera inside do not distort, optical axis is perpendicular to imaging plane, and through the center of plane, the imaging model of camera can be described as
Wherein, (x d, y d) be an object point P in the camera coordinate system coordinate under imaging plane coordinate system, the focal length that f is video camera.
In fact, the camera lens of mobile terminal camera inevitably can cause the distortion of image.First consider the linear distortion model of video camera inside: skew has occurred the center origin of imaging plane---projection centre (being the principal point of image) on the plane of delineation, as Fig. 9, x axle and the y axle corresponding to the plane of delineation also has corresponding yardstick flexible, introduces contraction-expansion factor k xand k y.
This distortion process can be described as
u = k x x + u o v = k y y + v 0
Wherein,
x = X c f z c y = Y c f z c
(x, y) is object point P in the camera coordinate system coordinate under imaging plane coordinate system, and (u is v) that space point is at the position of plane of delineation coordinate system, (u 0, v 0) be the principal point coordinate of image (being the focus of camera optical axis and the plane of delineation), (x c, y c, z c) be the coordinate of object point P in camera coordinate system.
If the plane of delineation not only has the distortion of figure, and distortion has occurred, coordinate axis is nonopiate, and as Figure 10, on the basis of distortion 1, this distortion process can be described as
u = k x - k x y cot θ + u 0 v = y k y sin θ + v 0
Order,
f x = f k x f y = k y sin θ s = f y f x
, the distortion process of mobile terminal camera inside can be expressed as
z c u v 1 = f x s u 0 0 f y v o 0 0 1 x c y c z c = k x c y c z c
Here,
k = f x s u 0 0 f y v o 0 0 1
K is relevant with the inner structure of video camera, is called camera intrinsic parameter matrix.F x, f ybe respectively the scale factor of video camera on u, v direction of principal axis, the distortion factor that s is video camera, the windup-degree that θ is the plane of delineation.
Utilize above-mentioned registration algorithm, the virtual scene at sight spot can be fixed on real scene firmly, realize the fusion of virtual scene and real scene.
The present invention is not limited to aforesaid embodiment.The present invention expands to any new feature or any new combination disclosing in this manual, and the arbitrary new method disclosing or step or any new combination of process.

Claims (10)

1. the intelligent guide implementation method based on mobile Internet, is characterized in that, comprising:
Step 1: sight spot Tourism Information Resources corresponding to each sight spot ID stored in the memory block of guide service device;
Step 2: mobile terminal gathers sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device;
Step 3: guide service device extracts in the ID, memory block, sight spot in the locating information of sight spot and searches the sight spot Tourism Information Resources that this sight spot ID is corresponding;
Step 4: guide service device is pushed to described mobile terminal by sight spot Tourism Information Resources corresponding to described sight spot ID by mobile network;
Step 5: described mobile terminal is presented to user by sight spot Tourism Information Resources.
2. a kind of intelligent guide implementation method based on mobile Internet according to claim 1, is characterized in that, described sight spot Tourism Information Resources comprises sight spot character introduction, sight spot picture, sight spot commentary and sight spot animation; And
The document that sight spot character introduction is converted to PDF is stored in described memory block;
The file that sight spot picture is converted to jpeg format is stored in described memory block;
The file that sight spot commentary is converted to MP4 form is stored in described memory block;
The animation file that is swf form by sight spot animated transition is stored in described memory block.
3. a kind of intelligent guide implementation method based on mobile Internet according to claim 1, is characterized in that, described sight spot locating information is sight spot voice signal, sight spot Quick Response Code, sight spot photo or sight spot GPS information.
4. a kind of intelligent guide implementation method based on mobile Internet according to claim 3, is characterized in that, in step 3, the step of extracting sight spot ID from sight spot photo further comprises:
Sight spot photo is carried out to pre-service;
Pretreated sight spot photo is carried out to feature extraction;
Described feature is mated with the picture in sight spot picture database on guide service device, obtain sight spot ID.
5. a kind of intelligent guide implementation method based on mobile Internet according to claim 3, is characterized in that, in step 3, from the step of GPS information extraction sight spot, sight spot ID, further comprises:
The latitude and longitude coordinates of taking out one by one each sight spot ID in sight spot latitude and longitude coordinates database from guide service device;
Calculate distance between latitude and longitude coordinates in the GPS information of described sight spot and the latitude and longitude coordinates of described sight spot ID;
If described distance within the scope of the error of calculation, is returned to described sight spot ID; Otherwise locate unsuccessfully at sight spot.
6. a kind of intelligent guide implementation method based on mobile Internet according to claim 2, is characterized in that,
Described step 2 also comprises: mobile terminal is taken pictures by the tourist attractions at user place or capture video obtains real scene, then by mobile network, is transferred to guide service device;
Described step 3 also comprises: described real scene is carried out to registration; From guide service device, in virtual scene storehouse, extract virtual scene figure; According to the result of registration, described virtual scene and real scene are merged to the image after being merged;
Described step 4 also comprises: guide service device is pushed to described mobile terminal by the image after described fusion by mobile network;
Described step 5 also comprises: described mobile terminal is presented to user by the image after merging.
7. the intelligent tour guide device based on mobile Internet, is characterized in that, comprises mobile client module and guide service module;
Described mobile client module is installed on mobile terminal, for controlling mobile terminal, gathers sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device; And control mobile terminal presents to user the sight spot Tourism Information Resources that tourist service module pushes;
Described tourist service module is installed on guide service device, for sight spot Tourism Information Resources corresponding to each sight spot ID being stored into the memory block of guide service device; Extract in the ID, memory block, sight spot in the locating information of sight spot and search the sight spot Tourism Information Resources that this sight spot ID is corresponding; And sight spot Tourism Information Resources corresponding to described sight spot ID is pushed to described mobile terminal by mobile network.
8. a kind of intelligent tour guide device based on mobile Internet according to claim 7, is characterized in that, described sight spot Tourism Information Resources comprises sight spot character introduction, sight spot picture, sight spot commentary and sight spot animation; And
The document that sight spot character introduction is converted to PDF is stored in the memory block of described tourist service platform;
The file that sight spot picture is converted to jpeg format is stored in the memory block of described tourist service platform;
The file that sight spot commentary is converted to MP4 form is stored in the memory block of described tourist service platform;
The animation file that is swf form by sight spot animated transition is stored in the memory block of described tourist service platform.
9. a kind of intelligent tour guide device based on mobile Internet according to claim 7, is characterized in that, described sight spot locating information is sight spot voice signal, sight spot Quick Response Code, sight spot photo or sight spot GPS information.
10. the mobile client in the intelligent tour guide device based on mobile Internet, it is characterized in that, described mobile client is installed on mobile terminal, for controlling mobile terminal, gathers sight spot locating information, then by mobile network, described sight spot locating information is transferred to guide service device; And control mobile terminal presents to user the sight spot Tourism Information Resources that tourist service device pushes.
CN201310652180.7A 2013-12-03 2013-12-03 A kind of intelligent guide implementation method based on mobile Internet, device and mobile client Active CN103632626B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310652180.7A CN103632626B (en) 2013-12-03 2013-12-03 A kind of intelligent guide implementation method based on mobile Internet, device and mobile client

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310652180.7A CN103632626B (en) 2013-12-03 2013-12-03 A kind of intelligent guide implementation method based on mobile Internet, device and mobile client

Publications (2)

Publication Number Publication Date
CN103632626A true CN103632626A (en) 2014-03-12
CN103632626B CN103632626B (en) 2016-06-29

Family

ID=50213614

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310652180.7A Active CN103632626B (en) 2013-12-03 2013-12-03 A kind of intelligent guide implementation method based on mobile Internet, device and mobile client

Country Status (1)

Country Link
CN (1) CN103632626B (en)

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103777901A (en) * 2013-12-27 2014-05-07 一派视觉(北京)数字科技有限公司 History reappearing method and system used for scenic spot visiting
CN104244176A (en) * 2014-07-29 2014-12-24 上海本脉信息科技有限公司 Tour guiding system
CN104298965A (en) * 2014-09-12 2015-01-21 东北大学 Intelligent scenic spot and scenery recognition system and method oriented to mobile terminal
CN104468700A (en) * 2014-10-14 2015-03-25 步步高教育电子有限公司 Method and system for electronic graffiti in tourist attractions
CN104598589A (en) * 2015-01-20 2015-05-06 惠州Tcl移动通信有限公司 Intelligent tourist method and system based on image identification
CN104700751A (en) * 2015-01-28 2015-06-10 深圳市元征科技股份有限公司 Scenic spot information acquisition method and device
CN104899920A (en) * 2015-05-25 2015-09-09 联想(北京)有限公司 Image processing method, image processing device and electronic device
CN105007320A (en) * 2015-07-16 2015-10-28 山东慧行天下文化传媒有限公司 Mobile intelligent tour guiding and navigating system based on cloud server
CN105025442A (en) * 2015-08-10 2015-11-04 贵州大学 Design method for location-based scenic region electronic interpretation service system and system thereof
CN105208130A (en) * 2015-10-13 2015-12-30 中国联合网络通信集团有限公司 Scenic spot explanation method and system, server and terminal
CN105468639A (en) * 2014-09-09 2016-04-06 许昌学院 Intelligent aiding method and apparatus
CN105657038A (en) * 2016-02-04 2016-06-08 云南今日游情科技有限公司 Multifunctional tourist attraction service system with team organization function and realization method
CN105653634A (en) * 2015-12-25 2016-06-08 北京金山安全软件有限公司 Method and device for pushing information of shot object
CN105868564A (en) * 2016-04-05 2016-08-17 苏州联康网络有限公司 Disease treatment hospital recommendation system
CN105868800A (en) * 2016-03-23 2016-08-17 立德高科(昆山)数码科技有限责任公司 Method and system for identifying and reading scenic spot fault two-dimensional code to upload scenic spot fault information
CN105868229A (en) * 2015-11-25 2016-08-17 乐视云计算有限公司 Tourist navigation method and apparatus
CN105912555A (en) * 2016-02-04 2016-08-31 姚晓宁 Interaction reproduction method of data information and reality space
CN106127621A (en) * 2016-06-15 2016-11-16 金钱象网络科技(北京)有限公司 Method and device is introduced at a kind of sight spot automatically
CN106302551A (en) * 2016-10-26 2017-01-04 邵春满 A kind of network online virtual tourism service system
CN106548666A (en) * 2016-12-23 2017-03-29 李雪 A kind of learning method and system of mobile base station operation and maintenance
CN106708267A (en) * 2016-12-26 2017-05-24 上海今尚数码科技有限公司 Method for switching to panoramic display through augmented reality technology
CN106782223A (en) * 2016-11-15 2017-05-31 上海悦野健康科技有限公司 A kind of virtual guide device and implementation method
CN106778649A (en) * 2016-12-26 2017-05-31 曲东阳 A kind of image recognition algorithm of judgement sight spot marker
CN106846237A (en) * 2017-02-28 2017-06-13 山西辰涵影视文化传媒有限公司 A kind of enhancing implementation method based on Unity3D
CN107133583A (en) * 2017-04-27 2017-09-05 深圳前海弘稼科技有限公司 One kind plants plant information acquisition method and device
CN107170399A (en) * 2017-05-18 2017-09-15 北京市育学林教育技术有限公司 The self-service guide system of mobile phone and its application method
CN107248169A (en) * 2016-03-29 2017-10-13 中兴通讯股份有限公司 Image position method and device
CN107816983A (en) * 2017-08-28 2018-03-20 深圳市赛亿科技开发有限公司 A kind of shopping guide method and system based on AR glasses
CN108200539A (en) * 2018-01-09 2018-06-22 苏州工业职业技术学院 Noiseless self-guide system
CN108234868A (en) * 2017-12-26 2018-06-29 五邑大学 The intelligent camera system and method for a kind of case-based reasioning
CN108337664A (en) * 2018-01-22 2018-07-27 北京中科视维文化科技有限公司 Tourist attraction augmented reality interaction guide system based on geographical location and method
CN108469983A (en) * 2018-04-02 2018-08-31 西南交通大学 A kind of virtual machine deployment method based on particle cluster algorithm under cloud environment
CN108510892A (en) * 2018-05-18 2018-09-07 广州奥翼电子科技股份有限公司 A kind of message board
CN108572969A (en) * 2017-03-09 2018-09-25 阿里巴巴集团控股有限公司 The method and device of geography information point recommended information is provided
CN108665402A (en) * 2018-05-11 2018-10-16 华南师范大学 Destination Management method and system based on cloud computing
CN110060611A (en) * 2019-03-15 2019-07-26 深圳壹账通智能科技有限公司 Intelligent interaction guidance method, device and storage medium, server
CN110349504A (en) * 2019-07-03 2019-10-18 武汉子序科技股份有限公司 A kind of museum guiding system based on AR
CN110703922A (en) * 2019-10-22 2020-01-17 成都中科大旗软件股份有限公司 Electronic map tour guide method special for tourist attraction
CN112822636A (en) * 2019-11-15 2021-05-18 南宁富桂精密工业有限公司 Method and device for providing augmented reality tour guide
CN112967641A (en) * 2020-10-22 2021-06-15 太极计算机股份有限公司 Automatic identification explanation and enhanced display method for scenic spot based on AR technology
US11087134B2 (en) 2017-05-30 2021-08-10 Artglass Usa, Llc Augmented reality smartglasses for use at cultural sites
CN114201694A (en) * 2020-09-18 2022-03-18 苏州逸时光网络科技有限公司 Tourism service management system and management method thereof
CN117516485A (en) * 2024-01-04 2024-02-06 东北大学 Pose vision measurement method for automatic guiding and mounting of aircraft engine
US12001974B2 (en) 2017-05-30 2024-06-04 Artglass Usa Llc Augmented reality smartglasses for use at cultural sites

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1913473A (en) * 2006-09-01 2007-02-14 张宇 Mobile multimedia intelligent guide service system and its complementing method
CN101217016A (en) * 2008-01-14 2008-07-09 浙江大学 Voice guidance method allowing dynamic configuration
CN101488308A (en) * 2009-01-21 2009-07-22 东北大学 Intelligent tourist guide system and method
CN101510913A (en) * 2009-03-17 2009-08-19 山东师范大学 System and method for implementing intelligent mobile phone enhancement based on three-dimensional electronic compass
CN101567159A (en) * 2009-06-10 2009-10-28 北京豪仪测控工程有限公司 Navigation method based on image identification technology and navigation apparatus
CN101702165A (en) * 2009-10-30 2010-05-05 高翔 Live-action information system and method thereof based on GPS positioning and direction identification technology
CN101719986A (en) * 2009-12-30 2010-06-02 湖北莲花山计算机视觉和信息科学研究院 PTZ tracking method and system based on multi-layered full-view modeling
CN101769747A (en) * 2009-12-21 2010-07-07 戴文娟 Intelligent tour conducting system and method for scenery spots
CN101893811A (en) * 2010-06-30 2010-11-24 北京理工大学 Portable projection display enhancement implementing system
CN102339579A (en) * 2011-10-13 2012-02-01 上海旅游网旅行服务有限公司 Guide system
CN102402855A (en) * 2011-08-29 2012-04-04 深圳市蓝盾科技有限公司 Method and system of fusing real-time panoramic videos of double cameras for intelligent traffic
CN102735100A (en) * 2012-06-08 2012-10-17 重庆邮电大学 Individual light weapon shooting training method and system by using augmented reality technology
CN202615752U (en) * 2012-05-09 2012-12-19 秦霄羽 Intelligent self-service electronic tour guide device
CN103106252A (en) * 2013-01-16 2013-05-15 浙江大学 Method for using handheld device to position plane area
CN103200358A (en) * 2012-01-06 2013-07-10 杭州普维光电技术有限公司 Coordinate transformation method and device between camera and goal scene

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1913473A (en) * 2006-09-01 2007-02-14 张宇 Mobile multimedia intelligent guide service system and its complementing method
CN101217016A (en) * 2008-01-14 2008-07-09 浙江大学 Voice guidance method allowing dynamic configuration
CN101488308A (en) * 2009-01-21 2009-07-22 东北大学 Intelligent tourist guide system and method
CN101510913A (en) * 2009-03-17 2009-08-19 山东师范大学 System and method for implementing intelligent mobile phone enhancement based on three-dimensional electronic compass
CN101567159A (en) * 2009-06-10 2009-10-28 北京豪仪测控工程有限公司 Navigation method based on image identification technology and navigation apparatus
CN101702165A (en) * 2009-10-30 2010-05-05 高翔 Live-action information system and method thereof based on GPS positioning and direction identification technology
CN101769747A (en) * 2009-12-21 2010-07-07 戴文娟 Intelligent tour conducting system and method for scenery spots
CN101719986A (en) * 2009-12-30 2010-06-02 湖北莲花山计算机视觉和信息科学研究院 PTZ tracking method and system based on multi-layered full-view modeling
CN101893811A (en) * 2010-06-30 2010-11-24 北京理工大学 Portable projection display enhancement implementing system
CN102402855A (en) * 2011-08-29 2012-04-04 深圳市蓝盾科技有限公司 Method and system of fusing real-time panoramic videos of double cameras for intelligent traffic
CN102339579A (en) * 2011-10-13 2012-02-01 上海旅游网旅行服务有限公司 Guide system
CN103200358A (en) * 2012-01-06 2013-07-10 杭州普维光电技术有限公司 Coordinate transformation method and device between camera and goal scene
CN202615752U (en) * 2012-05-09 2012-12-19 秦霄羽 Intelligent self-service electronic tour guide device
CN102735100A (en) * 2012-06-08 2012-10-17 重庆邮电大学 Individual light weapon shooting training method and system by using augmented reality technology
CN103106252A (en) * 2013-01-16 2013-05-15 浙江大学 Method for using handheld device to position plane area

Cited By (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103777901A (en) * 2013-12-27 2014-05-07 一派视觉(北京)数字科技有限公司 History reappearing method and system used for scenic spot visiting
CN104244176A (en) * 2014-07-29 2014-12-24 上海本脉信息科技有限公司 Tour guiding system
CN105468639A (en) * 2014-09-09 2016-04-06 许昌学院 Intelligent aiding method and apparatus
CN105468639B (en) * 2014-09-09 2019-03-15 许昌学院 A kind of intelligence householder method and device
CN104298965A (en) * 2014-09-12 2015-01-21 东北大学 Intelligent scenic spot and scenery recognition system and method oriented to mobile terminal
CN104468700A (en) * 2014-10-14 2015-03-25 步步高教育电子有限公司 Method and system for electronic graffiti in tourist attractions
CN104598589A (en) * 2015-01-20 2015-05-06 惠州Tcl移动通信有限公司 Intelligent tourist method and system based on image identification
CN104700751B (en) * 2015-01-28 2018-01-30 深圳市元征科技股份有限公司 The acquisition methods and device of a kind of sight spot information
CN104700751A (en) * 2015-01-28 2015-06-10 深圳市元征科技股份有限公司 Scenic spot information acquisition method and device
CN104899920B (en) * 2015-05-25 2019-03-08 联想(北京)有限公司 Image processing method, image processing apparatus and electronic equipment
CN104899920A (en) * 2015-05-25 2015-09-09 联想(北京)有限公司 Image processing method, image processing device and electronic device
CN105007320B (en) * 2015-07-16 2016-04-13 山东慧行天下文化传媒有限公司 Based on the intelligent movable tourist guide system of Cloud Server
CN105007320A (en) * 2015-07-16 2015-10-28 山东慧行天下文化传媒有限公司 Mobile intelligent tour guiding and navigating system based on cloud server
CN105025442A (en) * 2015-08-10 2015-11-04 贵州大学 Design method for location-based scenic region electronic interpretation service system and system thereof
CN105208130A (en) * 2015-10-13 2015-12-30 中国联合网络通信集团有限公司 Scenic spot explanation method and system, server and terminal
CN105868229A (en) * 2015-11-25 2016-08-17 乐视云计算有限公司 Tourist navigation method and apparatus
CN105653634A (en) * 2015-12-25 2016-06-08 北京金山安全软件有限公司 Method and device for pushing information of shot object
CN105653634B (en) * 2015-12-25 2019-03-26 北京金山安全软件有限公司 Method and device for pushing information of shot object
WO2017107376A1 (en) * 2015-12-25 2017-06-29 北京金山安全软件有限公司 Method and device for pushing information of photographed object
CN105912555A (en) * 2016-02-04 2016-08-31 姚晓宁 Interaction reproduction method of data information and reality space
CN105657038B (en) * 2016-02-04 2019-05-10 云南今日游情科技有限公司 A kind of tourist attractions multi-function service system and implementation method with function of forming a team
CN105657038A (en) * 2016-02-04 2016-06-08 云南今日游情科技有限公司 Multifunctional tourist attraction service system with team organization function and realization method
CN105912555B (en) * 2016-02-04 2019-03-05 北京通感科技有限公司 A kind of interaction reproducting method of data information and Imaging space
CN105868800A (en) * 2016-03-23 2016-08-17 立德高科(昆山)数码科技有限责任公司 Method and system for identifying and reading scenic spot fault two-dimensional code to upload scenic spot fault information
CN107248169B (en) * 2016-03-29 2021-01-22 中兴通讯股份有限公司 Image positioning method and device
CN107248169A (en) * 2016-03-29 2017-10-13 中兴通讯股份有限公司 Image position method and device
CN105868564A (en) * 2016-04-05 2016-08-17 苏州联康网络有限公司 Disease treatment hospital recommendation system
CN106127621A (en) * 2016-06-15 2016-11-16 金钱象网络科技(北京)有限公司 Method and device is introduced at a kind of sight spot automatically
CN106302551A (en) * 2016-10-26 2017-01-04 邵春满 A kind of network online virtual tourism service system
CN106782223A (en) * 2016-11-15 2017-05-31 上海悦野健康科技有限公司 A kind of virtual guide device and implementation method
CN106548666A (en) * 2016-12-23 2017-03-29 李雪 A kind of learning method and system of mobile base station operation and maintenance
CN106778649A (en) * 2016-12-26 2017-05-31 曲东阳 A kind of image recognition algorithm of judgement sight spot marker
CN106708267A (en) * 2016-12-26 2017-05-24 上海今尚数码科技有限公司 Method for switching to panoramic display through augmented reality technology
CN106846237A (en) * 2017-02-28 2017-06-13 山西辰涵影视文化传媒有限公司 A kind of enhancing implementation method based on Unity3D
CN108572969A (en) * 2017-03-09 2018-09-25 阿里巴巴集团控股有限公司 The method and device of geography information point recommended information is provided
WO2018196197A1 (en) * 2017-04-27 2018-11-01 深圳前海弘稼科技有限公司 Plant information acquisition method and apparatus
CN107133583A (en) * 2017-04-27 2017-09-05 深圳前海弘稼科技有限公司 One kind plants plant information acquisition method and device
CN107170399A (en) * 2017-05-18 2017-09-15 北京市育学林教育技术有限公司 The self-service guide system of mobile phone and its application method
US11087134B2 (en) 2017-05-30 2021-08-10 Artglass Usa, Llc Augmented reality smartglasses for use at cultural sites
US12001974B2 (en) 2017-05-30 2024-06-04 Artglass Usa Llc Augmented reality smartglasses for use at cultural sites
CN107816983A (en) * 2017-08-28 2018-03-20 深圳市赛亿科技开发有限公司 A kind of shopping guide method and system based on AR glasses
CN108234868A (en) * 2017-12-26 2018-06-29 五邑大学 The intelligent camera system and method for a kind of case-based reasioning
CN108200539A (en) * 2018-01-09 2018-06-22 苏州工业职业技术学院 Noiseless self-guide system
CN108337664B (en) * 2018-01-22 2021-07-27 北京中科视维文化科技有限公司 Tourist attraction augmented reality interactive navigation system and method based on geographical position
CN108337664A (en) * 2018-01-22 2018-07-27 北京中科视维文化科技有限公司 Tourist attraction augmented reality interaction guide system based on geographical location and method
CN108469983A (en) * 2018-04-02 2018-08-31 西南交通大学 A kind of virtual machine deployment method based on particle cluster algorithm under cloud environment
CN108665402A (en) * 2018-05-11 2018-10-16 华南师范大学 Destination Management method and system based on cloud computing
CN108510892A (en) * 2018-05-18 2018-09-07 广州奥翼电子科技股份有限公司 A kind of message board
CN110060611A (en) * 2019-03-15 2019-07-26 深圳壹账通智能科技有限公司 Intelligent interaction guidance method, device and storage medium, server
CN110349504A (en) * 2019-07-03 2019-10-18 武汉子序科技股份有限公司 A kind of museum guiding system based on AR
CN110703922A (en) * 2019-10-22 2020-01-17 成都中科大旗软件股份有限公司 Electronic map tour guide method special for tourist attraction
CN112822636A (en) * 2019-11-15 2021-05-18 南宁富桂精密工业有限公司 Method and device for providing augmented reality tour guide
CN114201694A (en) * 2020-09-18 2022-03-18 苏州逸时光网络科技有限公司 Tourism service management system and management method thereof
CN112967641A (en) * 2020-10-22 2021-06-15 太极计算机股份有限公司 Automatic identification explanation and enhanced display method for scenic spot based on AR technology
CN112967641B (en) * 2020-10-22 2023-02-17 太极计算机股份有限公司 Automatic identification explanation and enhanced display method for scenic spot based on AR technology
CN117516485A (en) * 2024-01-04 2024-02-06 东北大学 Pose vision measurement method for automatic guiding and mounting of aircraft engine
CN117516485B (en) * 2024-01-04 2024-03-22 东北大学 Pose vision measurement method for automatic guiding and mounting of aircraft engine

Also Published As

Publication number Publication date
CN103632626B (en) 2016-06-29

Similar Documents

Publication Publication Date Title
CN103632626B (en) A kind of intelligent guide implementation method based on mobile Internet, device and mobile client
CN104376118B (en) The outdoor moving augmented reality method of accurate interest point annotation based on panorama sketch
CN103913174B (en) The generation method and system of a kind of navigation information and mobile client and server end
CN110689623B (en) Tourist guide system and method based on augmented reality display
CN107133325B (en) Internet photo geographic space positioning method based on street view map
KR101867558B1 (en) Computerized method and device for annotating at least one feature of an image of a view
JP4591353B2 (en) Character recognition device, mobile communication system, mobile terminal device, fixed station device, character recognition method, and character recognition program
CN101833896B (en) Geographic information guide method and system based on augment reality
CN102884400B (en) Messaging device, information processing system and program
CN110443898A (en) A kind of AR intelligent terminal target identification system and method based on deep learning
CN103335657A (en) Method and system for strengthening navigation performance based on image capture and recognition technology
CN102667855A (en) Method for determining the pose of a camera and for recognizing an object of a real environment
CN110442813B (en) Travel commemorative information processing system and method based on AR
CN103778261A (en) Self-guided tour method based on mobile cloud computing image recognition
CN104298965A (en) Intelligent scenic spot and scenery recognition system and method oriented to mobile terminal
US11915478B2 (en) Bayesian methodology for geospatial object/characteristic detection
CN104778190A (en) Method and electronic apparatus for retrieving map
CN111767854B (en) SLAM loop detection method combined with scene text semantic information
CN112650772A (en) Data processing method, data processing device, storage medium and computer equipment
CN108534781A (en) Indoor orientation method based on video
CN111626971A (en) Smart city CIM real-time imaging method with image semantic perception
CN109982239A (en) Store floor positioning system and method based on machine vision
CN111784822A (en) Smart city CIM real-time imaging method with image semantic perception
KR102555668B1 (en) Method of generating map and visual localization using the map
US9245192B2 (en) Ad collateral detection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent of invention or patent application
CB03 Change of inventor or designer information

Inventor after: Xu Yuanyuan

Inventor after: Liu Ying

Inventor after: Wang Tiyong

Inventor after: Ren Yidong

Inventor after: Ju Mencheng

Inventor after: Jia Mingzheng

Inventor after: Wang Junrui

Inventor after: Meng Xianwei

Inventor after: Zhou Changgui

Inventor before: Huang Wenpei

Inventor before: Zhou Changgui

Inventor before: Xu Yuanyuan

Inventor before: Liu Ying

Inventor before: Wang Tiyong

Inventor before: Ren Yidong

Inventor before: Ju Mencheng

Inventor before: Jia Mingzheng

Inventor before: Wang Junrui

Inventor before: Meng Xianwei

C14 Grant of patent or utility model
GR01 Patent grant