CN113486205A - Plant science popularization information system based on augmented virtual reality technology - Google Patents

Plant science popularization information system based on augmented virtual reality technology Download PDF

Info

Publication number
CN113486205A
CN113486205A CN202110763745.3A CN202110763745A CN113486205A CN 113486205 A CN113486205 A CN 113486205A CN 202110763745 A CN202110763745 A CN 202110763745A CN 113486205 A CN113486205 A CN 113486205A
Authority
CN
China
Prior art keywords
plant
dimensional model
information
picture
science popularization
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110763745.3A
Other languages
Chinese (zh)
Other versions
CN113486205B (en
Inventor
刘通
赵晶
覃俊
苏建同
张敏
杨丹红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Forestry University
Original Assignee
Beijing Forestry University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Forestry University filed Critical Beijing Forestry University
Priority to CN202110763745.3A priority Critical patent/CN113486205B/en
Publication of CN113486205A publication Critical patent/CN113486205A/en
Application granted granted Critical
Publication of CN113486205B publication Critical patent/CN113486205B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

The invention discloses a plant science popularization information system based on an augmented virtual reality technology, which comprises: the terminal acquires a plant graph to be identified; the identification server responds to the request of the terminal, compares the plant graph to be identified with the identification picture of the picture library of the identification server, and returns the plant label corresponding to the identification picture; the plant science popularization information server stores plant picture information and three-dimensional model information; responding to a request of a terminal, and returning corresponding plant picture information and three-dimensional model information by the plant science popularization information server according to the plant label; and rendering and displaying the three-dimensional model or the plant picture information by the terminal. On one hand, the three-dimensional model can be displayed to the user in real time, the sensory experience of the user is enhanced, and the user obtains more three-dimensional information to improve the popular science effect; on the other hand, the strong cloud identification capability of the identification server can be utilized to accurately identify the plants.

Description

Plant science popularization information system based on augmented virtual reality technology
Technical Field
The invention relates to the technical field of information, in particular to a plant science popularization information system based on an augmented virtual reality technology.
Background
The research and development of the plant science popularization information system are beneficial to perfecting the construction of the plant park and improving the experience of tourists in the plant park. In the prior art, the information of plants and flowers can be fed back immediately after pictures are taken on site, such as hundred-degree picture recognition, on-line plant recognition, picture recognition by pictures and flower recognition. However, the feedback information is text information or plane picture information, which cannot reflect the spatial form of the plant or flower and cannot bring the spatial and stereoscopic sensory experience of the plant or flower to the user, so that the experience degree of the user is low and the corresponding popular science effect is also reduced.
Therefore, it is necessary to design a plant science popularization information system based on the augmented virtual reality technology, which can solve the above problems.
Disclosure of Invention
It is an object of the present invention to address at least the above-mentioned deficiencies and to provide at least the advantages which will be described hereinafter.
The invention also aims to provide a plant science popularization information system based on the augmented virtual reality technology, which can display the corresponding three-dimensional model in real time after the terminal scans the identification picture so as to enhance the sensory experience of the user and improve the science popularization effect.
Another object of the present invention is to provide a plant science popularization information system based on augmented virtual reality technology, comprising:
the terminal acquires a plant graph to be identified;
the identification server responds to the request of the terminal, compares the plant graph to be identified with the identification picture of the picture library of the identification server, and returns the plant label corresponding to the identification picture;
the plant science popularization information server stores plant picture information and three-dimensional model information; responding to a request of a terminal, and returning corresponding plant picture information and three-dimensional model information by the plant science popularization information server according to the plant label;
and rendering and displaying the three-dimensional model or the plant picture information by the terminal.
According to the technical scheme, the terminal obtains the plant picture to be identified in real time, the plant picture to be identified is uploaded to the identification server, the identification server compares the plant picture to be identified with the identification pictures in the picture library to obtain the corresponding identification pictures, then the plant labels of the corresponding identification pictures are returned to the terminal, the terminal sends the plant labels to the plant science popularization information server as requests, the plant science popularization information server feeds back the corresponding plant picture information and the three-dimensional model information to the terminal according to the plant labels, and the terminal can directly display the plant picture information or display the three-dimensional model information after rendering. On one hand, the design can show the three-dimensional model to a user in real time, so that the sensory experience of the user is enhanced, and the user obtains more three-dimensional information to improve the popular science effect; on the other hand, the strong cloud identification capability of the identification server can be utilized to accurately identify the plants; the terminal only needs to play the functions of acquiring the picture to be recognized and displaying the three-dimensional model, does not need to download a huge database, and is convenient to use and high in experience degree; and finally, after the terminal receives the three-dimensional model, the three-dimensional model can be rendered and displayed by utilizing the strong software capability of the terminal, the display effect is optimized, the data transmission quantity among the terminal, the identification server and the plant science popularization information server is reduced, and the corresponding speed is improved.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, the terminal is provided with a picture acquisition module for acquiring a plant picture to be identified, and a three-dimensional model display module for rendering and displaying a three-dimensional model.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, the picture acquisition module scans and acquires the plant image to be recognized through a camera of the terminal based on the WEB application technology, and uploads the plant image to be recognized to the recognition server through the WebRTC interface.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, the plant science popularization information server loads and displays the three-dimensional model by using an open-source three.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, the three-dimensional model obtained from the plant science popularization information server is compressed in a network transmission process. The three-dimensional model is a compressed three-dimensional model so as to reduce the size of a file and improve the transmission speed and the loading speed.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, the three-dimensional model display module displays the three-dimensional model based on a WEB application.
The client side of the android system or the apple iOS system supports WEB application, so that the three-dimensional model display of the android mobile phone and the apple mobile phone can be unified.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, when the three-dimensional model display module is a mobile client of the iOS system, the display of the three-dimensional model is realized by using an ARKit in an APP of the mobile client.
Preferably, in the plant science popularization information system based on the augmented virtual reality technology, the terminal is loaded with a plant map, the plant map at least comprises position information of various plants in the plant garden, and corresponding position tags are arranged at positions of the various plants in the plant map;
when the position label is clicked, the terminal sends a request to the plant science popularization information server, and the plant science popularization information server returns plant picture information or three-dimensional model information corresponding to the terminal in response to the request of the terminal;
and directly displaying the plant picture information or the three-dimensional model information on the corresponding position label.
Among the above-mentioned technical scheme, establish with plant garden assorted plant map to mark all kinds of plant position on the plant map, convenience of customers directly goes to corresponding position and visits study, and when corresponding position label was clicked simultaneously, corresponding plant picture information or three-dimensional model information presented in position label top, given the user show that advances, the user can be more accurate find the plant that wants to visit.
The invention has the following beneficial effects:
the terminal obtains the plant picture to be identified in real time, the plant picture to be identified is uploaded to the identification server, the identification server compares the plant picture to be identified with the identification pictures in the picture library to obtain the corresponding identification pictures, then the plant labels of the corresponding identification pictures are returned to the terminal, the terminal sends the plant labels to the plant science popularization information server as requests, the plant science popularization information server feeds back the corresponding plant picture information and the three-dimensional model information to the terminal according to the plant labels, and the terminal can directly display the plant picture information or display the three-dimensional model information after rendering. On one hand, the design can show the three-dimensional model to a user in real time, so that the sensory experience of the user is enhanced, and the user obtains more three-dimensional information to improve the popular science effect; on the other hand, the strong cloud identification capability of the identification server can be utilized to accurately identify the plants; the terminal only needs to play the functions of acquiring the picture to be recognized and displaying the three-dimensional model, does not need to download a huge database, and is convenient to use and high in experience degree; and finally, after the terminal receives the three-dimensional model, the three-dimensional model can be rendered and displayed by utilizing the strong software capability of the terminal, the display effect is optimized, the data transmission quantity among the terminal, the identification server and the plant science popularization information server is reduced, and the corresponding speed is improved.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention.
Drawings
FIG. 1 is a schematic diagram of a frame structure of a plant science popularization information system based on an augmented virtual reality technology according to the present invention;
fig. 2 is a flowchart of the plant science popularization information system based on the augmented virtual reality technology according to the present invention.
Detailed Description
The present invention is further described in detail below with reference to examples so that those skilled in the art can practice the invention with reference to the description.
Example 1
As shown in fig. 1 and 2, a plant science popularization information system based on augmented virtual reality technology includes:
the terminal acquires a plant graph to be identified;
the identification server responds to the request of the terminal, compares the plant graph to be identified with the identification picture of the picture library of the identification server, and returns the plant label corresponding to the identification picture;
the plant science popularization information server stores plant picture information and three-dimensional model information; responding to a request of a terminal, and returning corresponding plant picture information and three-dimensional model information by the plant science popularization information server according to the plant label;
and rendering and displaying the three-dimensional model or the plant picture information by the terminal.
During implementation, the terminal obtains a plant picture to be identified in real time, the plant picture to be identified is uploaded to the identification server, the identification server compares the plant picture to be identified with identification pictures in the picture library to obtain a corresponding identification picture, then a plant label of the corresponding identification picture is returned to the terminal, the terminal sends the plant label to the plant science popularization information server as a request, the plant science popularization information server feeds back corresponding plant picture information and three-dimensional model information to the terminal according to the plant label, and the terminal can directly display the plant picture information or display the three-dimensional model information after rendering.
For example, after obtaining the osmanthus fragrans plant map through the camera, the mobile smart phone sends a request to an identification server serving as a cloud server, the identification server compares the osmanthus fragrans plant map with a picture library to identify the osmanthus fragrans identification map, and then a terminal plant tag-osmanthus fragrans is returned; and then the terminal sends a corresponding request to the plant science popularization information server, the plant science popularization information server feeds back the plant picture information and the three-dimensional model of the osmanthus fragrans to the terminal, and the terminal displays the plant picture information or the three-dimensional model of the osmanthus fragrans according to the selection of the user.
On one hand, the design can show the three-dimensional model to a user in real time, so that the sensory experience of the user is enhanced, and the user obtains more three-dimensional information to improve the popular science effect; on the other hand, the strong cloud identification capability of the identification server can be utilized to accurately identify the plants; the terminal only needs to play the functions of acquiring the picture to be recognized and displaying the three-dimensional model, does not need to download a huge database, and is convenient to use and high in experience degree; and finally, after the terminal receives the three-dimensional model, the three-dimensional model can be rendered and displayed by utilizing the strong software capability of the terminal, the display effect is optimized, the data transmission quantity among the terminal, the identification server and the plant science popularization information server is reduced, and the corresponding speed is improved.
Example 2
On the basis of the embodiment 1, in the plant science popularization information system based on the augmented virtual reality technology, the terminal is provided with a picture acquisition module for acquiring a plant picture to be identified, and a three-dimensional model display module for rendering and displaying a three-dimensional model.
Further, the picture collection module is based on a WEB application technology, scans and acquires the plant graph to be identified through a camera of the terminal, and uploads the plant graph to be identified to the identification server through a WebRTC interface.
Further, the plant science popularization information server loads and displays the three-dimensional model by using an open-source three.
Further, the three-dimensional model obtained from the plant science popularization information server is compressed in the network transmission process. The three-dimensional model is a compressed three-dimensional model so as to reduce the size of a file and improve the transmission speed and the loading speed.
Further, the three-dimensional model display module displays a three-dimensional model based on a WEB application.
The client side of the android system or the apple iOS system supports WEB application, so that the three-dimensional model display of the android mobile phone and the apple mobile phone can be unified.
Further, when the three-dimensional model display module is a mobile client of the iOS system, displaying the three-dimensional model is realized by using an ARKit in the APP of the mobile client.
Example 3
On the basis of the embodiment 1, the terminal is loaded with a plant map, the plant map at least comprises position information of various plants in a plant garden, and corresponding position tags are arranged at positions of the various plants in the plant map;
when the position label is clicked, the terminal sends a request to the plant science popularization information server, and the plant science popularization information server returns plant picture information or three-dimensional model information corresponding to the terminal in response to the request of the terminal;
and directly displaying the plant picture information or the three-dimensional model information on the corresponding position label.
According to the embodiment, the plant map matched with the plant garden is established, the positions of various plants are marked on the plant map, a user can conveniently go to the corresponding positions to visit and study directly, and meanwhile, when the corresponding position tags are clicked, corresponding plant picture information or three-dimensional model information is presented above the position tags, so that the user can be presented in advance, and the user can find the plants which the user wants to visit more accurately.
While embodiments of the invention have been disclosed above, it is not intended to be limited to the uses set forth in the specification and examples. It can be applied to all kinds of fields suitable for the present invention. Additional modifications will readily occur to those skilled in the art.

Claims (8)

1. A plant science popularization information system based on augmented virtual reality technology, comprising:
the terminal acquires a plant graph to be identified;
the identification server responds to the request of the terminal, compares the plant graph to be identified with the identification picture of the picture library of the identification server, and returns the plant label corresponding to the identification picture;
the plant science popularization information server stores plant picture information and three-dimensional model information; responding to a request of a terminal, and returning corresponding plant picture information and three-dimensional model information by the plant science popularization information server according to the plant label;
and rendering and displaying the three-dimensional model or the plant picture information by the terminal.
2. The augmented virtual reality technology-based plant science popularization information system according to claim 1, wherein the terminal is provided with a picture acquisition module for acquiring a plant picture to be recognized and a three-dimensional model display module for rendering and displaying a three-dimensional model.
3. The plant science popularization information system based on the augmented virtual reality technology as claimed in claim 2, wherein the picture collection module scans and acquires the plant image to be recognized through a camera of the terminal based on a WEB application technology, and uploads the plant image to be recognized to the recognition server through a WebRTC interface.
4. The augmented virtual reality technology-based plant science popularization information system according to claim 3, wherein the plant science popularization information server loads and displays the three-dimensional model using an open-source three.
5. The augmented virtual reality technology-based plant science popularization information system according to claim 4, wherein the three-dimensional model obtained from the plant science popularization information server is compressed during network transmission.
6. The augmented virtual reality technology-based plant science popularization information system according to claim 5, wherein the three-dimensional model presentation module presents the three-dimensional model based on a WEB application.
7. The augmented virtual reality technology-based plant science popularization information system according to claim 6, wherein when the three-dimensional model display module is a mobile client of an iOS system, display of the three-dimensional model is realized within an APP of the mobile client using an ARKit.
8. The augmented virtual reality technology-based plant science popularization information system according to claim 1, wherein the terminal is loaded with a plant map, the plant map at least comprises position information of various plants in a plant park, and corresponding position tags are arranged at positions of the various plants in the plant map;
when the position label is clicked, the terminal sends a request to the plant science popularization information server, and the plant science popularization information server returns plant picture information or three-dimensional model information corresponding to the terminal in response to the request of the terminal;
and directly displaying the plant picture information or the three-dimensional model information on the corresponding position label.
CN202110763745.3A 2021-07-06 2021-07-06 Plant science popularization information system based on augmented virtual reality technology Active CN113486205B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110763745.3A CN113486205B (en) 2021-07-06 2021-07-06 Plant science popularization information system based on augmented virtual reality technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110763745.3A CN113486205B (en) 2021-07-06 2021-07-06 Plant science popularization information system based on augmented virtual reality technology

Publications (2)

Publication Number Publication Date
CN113486205A true CN113486205A (en) 2021-10-08
CN113486205B CN113486205B (en) 2023-07-25

Family

ID=77940404

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110763745.3A Active CN113486205B (en) 2021-07-06 2021-07-06 Plant science popularization information system based on augmented virtual reality technology

Country Status (1)

Country Link
CN (1) CN113486205B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104898954A (en) * 2015-06-23 2015-09-09 杭州汉典科技有限公司 Interactive reading method based on augmented reality technology
CN106095786A (en) * 2016-05-28 2016-11-09 北京花花草草科技有限公司 A kind of Plant identification and method
CN107222529A (en) * 2017-05-22 2017-09-29 北京邮电大学 Augmented reality processing method, WEB modules, terminal and cloud server
CN107392238A (en) * 2017-07-12 2017-11-24 华中师范大学 Outdoor knowledge of plants based on moving-vision search expands learning system
CN107610217A (en) * 2017-08-22 2018-01-19 中广核工程有限公司 A kind of nuclear power generating equipment virtually identifies display systems and method
CN108009891A (en) * 2017-12-15 2018-05-08 杨智勇 System and shelf and information displaying method based on Rich Media's display of commodity information
CN109699349A (en) * 2019-02-21 2019-05-03 北京农业信息技术研究中心 One plant growth 3D live broadcast device
CN109886283A (en) * 2017-12-06 2019-06-14 江西科骏实业有限公司 A kind of plant image intelligent identifying system based on AR
CN109934734A (en) * 2019-01-24 2019-06-25 北京德火科技有限责任公司 A kind of tourist attractions experiential method and system based on augmented reality
CN110136267A (en) * 2019-04-10 2019-08-16 青岛景泰动漫技术有限公司 A kind of the augmented reality display systems and method of actual situation reconstruct
CN110738737A (en) * 2019-10-15 2020-01-31 北京市商汤科技开发有限公司 AR scene image processing method and device, electronic equipment and storage medium
CN111640190A (en) * 2020-06-02 2020-09-08 浙江商汤科技开发有限公司 AR effect presentation method and apparatus, electronic device and storage medium
CN112036499A (en) * 2020-09-04 2020-12-04 西南民族大学 Traditional Chinese medicine identification method based on convolutional neural network
CN112686998A (en) * 2021-01-07 2021-04-20 腾讯科技(深圳)有限公司 Information display method, device and equipment and computer readable storage medium

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104898954A (en) * 2015-06-23 2015-09-09 杭州汉典科技有限公司 Interactive reading method based on augmented reality technology
CN106095786A (en) * 2016-05-28 2016-11-09 北京花花草草科技有限公司 A kind of Plant identification and method
CN107222529A (en) * 2017-05-22 2017-09-29 北京邮电大学 Augmented reality processing method, WEB modules, terminal and cloud server
CN107392238A (en) * 2017-07-12 2017-11-24 华中师范大学 Outdoor knowledge of plants based on moving-vision search expands learning system
CN107610217A (en) * 2017-08-22 2018-01-19 中广核工程有限公司 A kind of nuclear power generating equipment virtually identifies display systems and method
CN109886283A (en) * 2017-12-06 2019-06-14 江西科骏实业有限公司 A kind of plant image intelligent identifying system based on AR
CN108009891A (en) * 2017-12-15 2018-05-08 杨智勇 System and shelf and information displaying method based on Rich Media's display of commodity information
CN109934734A (en) * 2019-01-24 2019-06-25 北京德火科技有限责任公司 A kind of tourist attractions experiential method and system based on augmented reality
CN109699349A (en) * 2019-02-21 2019-05-03 北京农业信息技术研究中心 One plant growth 3D live broadcast device
CN110136267A (en) * 2019-04-10 2019-08-16 青岛景泰动漫技术有限公司 A kind of the augmented reality display systems and method of actual situation reconstruct
CN110738737A (en) * 2019-10-15 2020-01-31 北京市商汤科技开发有限公司 AR scene image processing method and device, electronic equipment and storage medium
CN111640190A (en) * 2020-06-02 2020-09-08 浙江商汤科技开发有限公司 AR effect presentation method and apparatus, electronic device and storage medium
CN112036499A (en) * 2020-09-04 2020-12-04 西南民族大学 Traditional Chinese medicine identification method based on convolutional neural network
CN112686998A (en) * 2021-01-07 2021-04-20 腾讯科技(深圳)有限公司 Information display method, device and equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN113486205B (en) 2023-07-25

Similar Documents

Publication Publication Date Title
US10885713B2 (en) Method, apparatus, and system for generating an AR application and rendering an AR instance
US9904664B2 (en) Apparatus and method providing augmented reality contents based on web information structure
CN106846497B (en) Method and device for presenting three-dimensional map applied to terminal
CN110019600B (en) Map processing method, map processing device and storage medium
CN105069644A (en) Shopping client based on augmented reality, server and system
CN105096180A (en) Commodity information display method and apparatus based augmented reality
CN103561065A (en) System and method for achieving 3D virtual advertisement with mobile terminal
CN103412892A (en) Method and system for displaying information
CN112150603B (en) Initial visual angle control and presentation method and system based on three-dimensional point cloud
CN103455142A (en) Image identification real-time three-dimensional interactive device and image identification real-time three-dimensional interactive method
Khan et al. Rebirth of augmented reality-enhancing reality via smartphones
CN112379815A (en) Image capturing method and device, storage medium and electronic equipment
CN103699652A (en) Webpage access method and webpage access system
CN113835703B (en) Method for drawing automatic driving monitoring visual map at WEB front end
ES2958257T3 (en) Product display systems and methods by using a single page application
CN111179438A (en) AR model dynamic fixing method and device, electronic equipment and storage medium
CN112560189A (en) Page display method and device, computer equipment and readable storage medium
CN113486205B (en) Plant science popularization information system based on augmented virtual reality technology
CN105677851A (en) Interface screenshot method and user device
CN108648255B (en) Asynchronous balance-based custom rendering method and device for samples
CN112667137B (en) Switching display method and device for house type graph and house three-dimensional model
CN115830212A (en) Three-dimensional model display method and related equipment
CN108521597B (en) Live broadcast information dynamic display method and device
KR20120002658A (en) Plant management information using a mobile terminals
CN113384892A (en) Method and device for acquiring and displaying material picture of scene model and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant