CN111765890A - Indoor navigation system and navigation algorithm based on cloud image recognition and AR - Google Patents

Indoor navigation system and navigation algorithm based on cloud image recognition and AR Download PDF

Info

Publication number
CN111765890A
CN111765890A CN202010596619.9A CN202010596619A CN111765890A CN 111765890 A CN111765890 A CN 111765890A CN 202010596619 A CN202010596619 A CN 202010596619A CN 111765890 A CN111765890 A CN 111765890A
Authority
CN
China
Prior art keywords
module
navigation
node
glasses
processing module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010596619.9A
Other languages
Chinese (zh)
Other versions
CN111765890B (en
Inventor
任秋安
高明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Inspur Scientific Research Institute Co Ltd
Original Assignee
Jinan Inspur Hi Tech Investment and Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jinan Inspur Hi Tech Investment and Development Co Ltd filed Critical Jinan Inspur Hi Tech Investment and Development Co Ltd
Priority to CN202010596619.9A priority Critical patent/CN111765890B/en
Publication of CN111765890A publication Critical patent/CN111765890A/en
Application granted granted Critical
Publication of CN111765890B publication Critical patent/CN111765890B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • G01C21/206Instruments for performing navigational calculations specially adapted for indoor navigation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02BCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B50/00Energy efficient technologies in elevators, escalators and moving walkways, e.g. energy saving or recuperation technologies

Abstract

The invention aims to provide an indoor navigation system and a navigation algorithm based on cloud image recognition and AR. It includes high in the clouds processing module and AR glasses module, AR glasses module includes communication module, the image acquisition module, a display module, processing module and rather than supporting module of charging, the image acquisition module is used for gathering glasses surrounding environment, processing module is used for handling the virtual formation of image of uploading and accepting high in the clouds navigation command to the image of gathering, display module is used for realizing the virtual navigation instruction of AR, high in the clouds processing module sets up in the cell-phone, communicate between AR glasses and the cell-phone, high in the clouds processing module is used for realizing image identification and visual positioning.

Description

Indoor navigation system and navigation algorithm based on cloud image recognition and AR
Technical Field
The invention relates to an indoor navigation system and a navigation algorithm based on cloud image recognition and AR, and belongs to the technical field of hardware manufacturing, software development and cloud platform development.
Background
The outdoor navigation technology is mature at present, not only is the route rich, but also the route can be intelligently recommended according to vehicles, but with the increase of large buildings, a navigation system which can be used indoors is also needed. Because of the multi-story building, an effective indoor navigation route cannot be provided, and the position of the destination cannot be correctly positioned by means of one story number or deviation information, so that a navigation technology which can help people to use indoors is particularly needed.
Disclosure of Invention
In order to help a user to carry out route navigation indoors, including steering and going upstairs and downstairs guiding, the invention aims to provide an indoor navigation system and a navigation algorithm based on cloud image recognition and AR.
In order to achieve the purpose, the invention is realized by the following technical scheme:
the utility model provides an indoor navigation based on high in clouds image recognition and AR, including high in the clouds processing module and AR glasses module, AR glasses module includes communication module, the image acquisition module, a display module, processing module and rather than supporting module of charging, the image acquisition module is used for gathering glasses surrounding environment, processing module is used for handling the image of gathering and uploads and accept the virtual formation of image of high in the clouds navigation order, display module is used for realizing the virtual navigation instruction of AR, high in the clouds processing module sets up in the cell-phone, communicate between AR glasses and the cell-phone, high in the clouds processing module is used for realizing image recognition and visual positioning.
According to the preferable scheme of the indoor navigation system, the mobile phone and the AR glasses module are in wireless communication through 5G and WIFI.
A navigation algorithm of an indoor navigation system based on cloud image recognition and AR comprises the following steps:
s1, changing a method for taking a child node from a position close to an initial node to a position for shooting by a mobile phone, and starting at each node in a camera visual angle range;
s2, two ends of the escalator become special nodes which are expressed as layered nodes;
and S3, during navigation, replanning according to the current position and the visual angle of the mobile phone until the mobile phone reaches the position near a navigation point.
According to the optimal navigation algorithm scheme of the indoor navigation system based on cloud image recognition and AR, the production process of the navigation pseudo code is as follows:
establishing a data list A only with an initial node, and adding the initial node into an OPEN table and a CLOSE table;
after the mobile phone is moved, adding nodes in the visual angle of a camera of the mobile phone into an OPEN table, finding out the node closest to a target point for virtual navigation, and adding the node into a CLOSE table;
if the escalator needs to pass through, the navigation is continued after the escalator reaches the other end of the escalator; if the target node appears in the visual angle, displaying the AR pointing direction at the position;
the above-mentioned node can carry out the subregion according to different architectural styles and structure to in finding the node that closes on the target point in the visual angle, above-mentioned escalator function can not be compatible with the elevator, because the number of piles when the elevator can not directly be confirmed to leave the elevator, needs the relocation.
The invention has the advantages that:
1. the cloud is used for image recognition, positioning and issuing navigation instructions, so that the configuration of the entity glasses is effectively reduced, and the problems of power consumption and heating are reduced;
2. the 5G module and the WIF module can be freely switched, so that the stability of network communication is enhanced;
3. the AR is used for navigation, so that the route guidance can be efficiently carried out, the use difficulty and the required understanding degree are reduced, and the user experience is improved;
4. convenient to use, high in the clouds data processing back that finishes, the user registers the registration through the cell-phone and can begin to use, and glasses are worn and can be navigated, need not carry out additionally.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a schematic block diagram of an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The utility model provides an indoor navigation based on high in clouds image recognition and AR, including high in the clouds processing module and AR glasses module, AR glasses module includes communication module, the image acquisition module, a display module, processing module and rather than supporting module of charging, the image acquisition module is used for gathering glasses surrounding environment, processing module is used for handling the image of gathering and uploads and accept the virtual formation of image of high in the clouds navigation order, display module is used for realizing the virtual navigation instruction of AR, high in the clouds processing module sets up in the cell-phone, communicate between AR glasses and the cell-phone, high in the clouds processing module is used for realizing image recognition and visual positioning.
According to the preferable scheme of the indoor navigation system, the mobile phone and the AR glasses module are in wireless communication through 5G and WIFI.
A navigation algorithm of an indoor navigation system based on cloud image recognition and AR comprises the following steps:
s1, changing a method for taking a child node from a position close to an initial node to a position for shooting by a mobile phone, and starting at each node in a camera visual angle range;
s2, two ends of the escalator become special nodes which are expressed as layered nodes;
and S3, during navigation, replanning according to the current position and the visual angle of the mobile phone until the mobile phone reaches the position near a navigation point.
According to the optimal navigation algorithm scheme of the indoor navigation system based on cloud image recognition and AR, the production process of the navigation pseudo code is as follows:
establishing a data list A only with an initial node, and adding the initial node into an OPEN table and a CLOSE table;
after the mobile phone is moved, adding nodes in the visual angle of a camera of the mobile phone into an OPEN table, finding out the node closest to a target point for virtual navigation, and adding the node into a CLOSE table;
if the escalator needs to pass through, the navigation is continued after the escalator reaches the other end of the escalator; if the target node appears in the visual angle, displaying the AR pointing direction at the position;
the above-mentioned node can carry out the subregion according to different architectural styles and structure to in finding the node that closes on the target point in the visual angle, above-mentioned escalator function can not be compatible with the elevator, because the number of piles when the elevator can not directly be confirmed to leave the elevator, needs the relocation.
The navigation algorithm provided by the invention is suitable for indoor navigation, not only saves the computing power, but also can be more conveniently combined with AR for navigation.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (4)

1. The utility model provides an indoor navigation based on high in clouds image recognition and AR which characterized in that: including high in the clouds processing module and AR glasses module, AR glasses module includes communication module, image acquisition module, a display module, processing module and rather than supporting module of charging, image acquisition module is used for gathering glasses surrounding environment, processing module is used for handling the virtual formation of uploading and accepting high in the clouds navigation command to the image of gathering, display module is used for realizing the virtual navigation instruction of AR, high in the clouds processing module sets up in the cell-phone, communicate between AR glasses and the cell-phone, high in the clouds processing module is used for realizing image identification and visual positioning.
2. The indoor navigation system of claim 1, wherein: the mobile phone and the AR glasses module are in wireless communication through 5G and WIFI.
3. A navigation algorithm of an indoor navigation system based on cloud image recognition and AR is characterized by comprising the following steps:
s1, changing a method for taking a child node from a position close to an initial node to a position for shooting by a mobile phone, and starting at each node in a camera visual angle range;
s2, two ends of the escalator become special nodes which are expressed as layered nodes;
and S3, during navigation, replanning according to the current position and the visual angle of the mobile phone until the mobile phone reaches the position near a navigation point.
4. The navigation algorithm of the cloud image recognition and AR based indoor navigation system of claim 3, wherein: the navigation pseudo-code production process is as follows:
establishing a data list A only with an initial node, and adding the initial node into an OPEN table and a CLOSE table;
after the mobile phone is moved, adding nodes in the visual angle of a camera of the mobile phone into an OPEN table, finding out the node closest to a target point for virtual navigation, and adding the node into a CLOSE table;
if the escalator needs to pass through, the navigation is continued after the escalator reaches the other end of the escalator; if the target node appears in the visual angle, displaying the AR pointing direction at the position;
the above-mentioned node can carry out the subregion according to different architectural styles and structure to in finding the node that closes on the target point in the visual angle, above-mentioned escalator function can not be compatible with the elevator, because the number of piles when the elevator can not directly be confirmed to leave the elevator, needs the relocation.
CN202010596619.9A 2020-06-28 2020-06-28 Navigation method of indoor navigation system based on cloud image recognition and AR Active CN111765890B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010596619.9A CN111765890B (en) 2020-06-28 2020-06-28 Navigation method of indoor navigation system based on cloud image recognition and AR

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010596619.9A CN111765890B (en) 2020-06-28 2020-06-28 Navigation method of indoor navigation system based on cloud image recognition and AR

Publications (2)

Publication Number Publication Date
CN111765890A true CN111765890A (en) 2020-10-13
CN111765890B CN111765890B (en) 2023-08-15

Family

ID=72722477

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010596619.9A Active CN111765890B (en) 2020-06-28 2020-06-28 Navigation method of indoor navigation system based on cloud image recognition and AR

Country Status (1)

Country Link
CN (1) CN111765890B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104280028A (en) * 2014-06-04 2015-01-14 上海赛图计算机科技有限公司 Realizing method for computing part involving path crossing floors based on indoor map path
CN107449426A (en) * 2017-07-14 2017-12-08 厦门市礼小签电子科技有限公司 Path search algorithm and navigational logic method and its indoor AR navigation system
CN107816992A (en) * 2017-08-28 2018-03-20 深圳市赛亿科技开发有限公司 A kind of indoor orientation method and system based on AR glasses
US20180143023A1 (en) * 2016-07-29 2018-05-24 Matterport, Inc. Determining and/or generating a navigation path through a captured three-dimensional model rendered on a device
CN109976690A (en) * 2019-03-27 2019-07-05 优奈柯恩(北京)科技有限公司 AR glasses remote interaction method, device and computer-readable medium
CN111028358A (en) * 2018-10-09 2020-04-17 香港理工大学深圳研究院 Augmented reality display method and device for indoor environment and terminal equipment
CN111065891A (en) * 2018-08-16 2020-04-24 北京嘀嘀无限科技发展有限公司 Indoor navigation system based on augmented reality
CN111123198A (en) * 2019-12-30 2020-05-08 华中科技大学 User positioning and navigation method and system in building
CN111157009A (en) * 2020-04-02 2020-05-15 深圳司南数据服务有限公司 Indoor positioning navigation creating method and system based on mobile terminal and AR (augmented reality) intelligence

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104280028A (en) * 2014-06-04 2015-01-14 上海赛图计算机科技有限公司 Realizing method for computing part involving path crossing floors based on indoor map path
US20180143023A1 (en) * 2016-07-29 2018-05-24 Matterport, Inc. Determining and/or generating a navigation path through a captured three-dimensional model rendered on a device
CN107449426A (en) * 2017-07-14 2017-12-08 厦门市礼小签电子科技有限公司 Path search algorithm and navigational logic method and its indoor AR navigation system
CN107816992A (en) * 2017-08-28 2018-03-20 深圳市赛亿科技开发有限公司 A kind of indoor orientation method and system based on AR glasses
CN111065891A (en) * 2018-08-16 2020-04-24 北京嘀嘀无限科技发展有限公司 Indoor navigation system based on augmented reality
CN111028358A (en) * 2018-10-09 2020-04-17 香港理工大学深圳研究院 Augmented reality display method and device for indoor environment and terminal equipment
CN109976690A (en) * 2019-03-27 2019-07-05 优奈柯恩(北京)科技有限公司 AR glasses remote interaction method, device and computer-readable medium
CN111123198A (en) * 2019-12-30 2020-05-08 华中科技大学 User positioning and navigation method and system in building
CN111157009A (en) * 2020-04-02 2020-05-15 深圳司南数据服务有限公司 Indoor positioning navigation creating method and system based on mobile terminal and AR (augmented reality) intelligence

Also Published As

Publication number Publication date
CN111765890B (en) 2023-08-15

Similar Documents

Publication Publication Date Title
CN107506391B (en) Method for extracting CAD drawing information to indoor map
CN104914866B (en) Crusing robot global path planning method and system based on topology point classification
CN103916875A (en) Management and planning system of multi-class control terminals based on WIFI wireless network
CN107450540A (en) Indoor mobile robot navigation system and method based on infrared road sign
CN107065409A (en) Trend projection arrangement and its method of work
CN205103563U (en) Realize intelligent wrist -watch of pronunciation navigation control
CN105737820A (en) Positioning and navigation method for indoor robot
WO2017101050A1 (en) Control method, control panel and control system for a smart home device
CN110072282B (en) Fusion positioning method
CN103499352A (en) Mobile GPS (global positioning system) real-scene navigation system based on street scene technology
CN111765890A (en) Indoor navigation system and navigation algorithm based on cloud image recognition and AR
CN114501411A (en) High-precision positioning system and method based on Bluetooth
CN104133483A (en) Minisize quadrotor-aircraft control system based on integrated positioning communication module and control method thereof
CN112424837A (en) Model correction method, device and equipment
CN105204054A (en) Cluster positioning and commanding system
CN106323268A (en) Mobile terminal positioning and travelling navigation method and mobile terminal
CN107479426A (en) A kind of robot synchronization performance control system and method
CN103442329A (en) Intelligent guide system based on smart phone platform
CN113532442A (en) Indoor AR pedestrian navigation method
EP3671484A1 (en) Display picture display method and terminal
CN109688593B (en) Charging base station deployment method based on core node rule
CN110519820A (en) A kind of method for routing applied in cluster UAV Communication
CN204707167U (en) All-direction multi-functional cell-phone camera servicing unit
CN109178333A (en) A kind of miniature drone networking operational method based on BIM
CN102393199B (en) One-key navigation method and system thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20230720

Address after: 250000 building S02, No. 1036, Gaoxin Inspur Road, Jinan, Shandong

Applicant after: Shandong Inspur Scientific Research Institute Co.,Ltd.

Address before: 250104 1st floor, R & D building, No. 2877, Suncun Town, Licheng District, Jinan City, Shandong Province

Applicant before: JINAN INSPUR HIGH-TECH TECHNOLOGY DEVELOPMENT Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant