CN111508078A - Crop pruning demonstration method, device and system based on 3D model - Google Patents
Crop pruning demonstration method, device and system based on 3D model Download PDFInfo
- Publication number
- CN111508078A CN111508078A CN202010212189.6A CN202010212189A CN111508078A CN 111508078 A CN111508078 A CN 111508078A CN 202010212189 A CN202010212189 A CN 202010212189A CN 111508078 A CN111508078 A CN 111508078A
- Authority
- CN
- China
- Prior art keywords
- pruning
- trimming
- crop
- model
- sand table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013138 pruning Methods 0.000 title claims abstract description 145
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000009966 trimming Methods 0.000 claims abstract description 130
- 239000004576 sand Substances 0.000 claims abstract description 43
- 230000008859 change Effects 0.000 claims abstract description 12
- 235000013399 edible fruits Nutrition 0.000 claims description 22
- 239000000463 material Substances 0.000 claims description 20
- 238000004891 communication Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 238000003860 storage Methods 0.000 claims description 7
- 238000009877 rendering Methods 0.000 claims description 6
- 238000005457 optimization Methods 0.000 claims description 5
- 230000003190 augmentative effect Effects 0.000 claims description 4
- 238000013136 deep learning model Methods 0.000 claims description 4
- 239000002689 soil Substances 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 16
- 239000003337 fertilizer Substances 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 150000001875 compounds Chemical class 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 244000038559 crop plants Species 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 241000894007 species Species 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 244000141353 Prunus domestica Species 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B25/00—Models for purposes not provided for in G09B23/00, e.g. full-sized devices for demonstration purposes
Abstract
The invention belongs to the technical field of crop planting, and relates to a crop pruning demonstration method, device and system based on a 3D model, wherein the method comprises the following steps: constructing a 3D virtual sand table system; receiving growth parameters, and generating and displaying a 3D standard tree model according to the growth parameters; receiving a pruning stage and pruning parameters; judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage; and if so, displaying the change of the 3D standard tree model after pruning according to the pruning parameters. The invention has the advantages of making the physical sand table inefficiently, saving the demonstration cost and improving the intuition and interactivity of the crop pruning process.
Description
Technical Field
The invention relates to the technical field of crop planting, in particular to a crop pruning demonstration method, device and system based on a 3D model.
Background
At present, technical guidance for crop pruning is mainly demonstrated by adopting a physical sand table. In this way, each physical sand table is only suitable for a single crop, and a plurality of sand tables need to be manufactured and designed when a plurality of crop plants are planted; not only the cost for manufacturing the physical sand table is higher; and the action essentials (including but not limited to the trimming angle, force, position, attention and the like) in the trimming process cannot be dynamically and vividly displayed. The technical difference of pruning in the environment with different geographical positions, climates and temperature differences cannot be dynamically and vividly simulated. The pruning cannot be intuitively simulated, and the prompting and guiding, attention reminding and the like of the standard technology are lacked in the process.
Disclosure of Invention
The invention aims to provide a crop pruning demonstration method, device and system based on a 3D model, which are used for solving the technical problems of high cost and low interactive guidance of a physical sand table in the prior art.
The invention provides a crop pruning demonstration method based on a 3D model, which comprises the following steps:
constructing a 3D virtual sand table system for crop pruning;
receiving growth parameters of a 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
receiving a pruning stage and pruning parameters of a user for pruning the 3D standard tree model;
judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage;
if the pruning parameter accords with the pre-stored pruning parameter standard of the 3D standard tree model in the pruning stage; and displaying the change of the 3D standard tree model after pruning according to the pruning parameters.
Preferably, the generating and displaying the virtual 3D standard tree model according to the growth parameters includes:
acquiring and updating the 3D material model file corresponding to the growth parameter in a server; 3D material model files of different crops are stored in the server;
analyzing and rendering the 3D material model file into a 3D standard tree model;
and displaying the 3D standard tree model in the sand table system working area.
The method further comprises the following steps:
storing the history images after each trimming according to the trimming sequence;
and when an undo instruction of a user is received, undoing the last pruning operation on the 3D standard tree model.
Preferably, the method further comprises:
recording a trimming stage and trimming parameters of a user, and inputting the trimming stage and the trimming parameters into a deep learning model for optimization;
and when the user logs in again, acquiring and displaying the optimized trimming stage and the trimming parameters.
Preferably, the 3D virtual sand table system for constructing crop pruning comprises:
s11, collecting locus shape data of crops, and constructing a 3D electronic sand table of the region where the crops are located by combining a GIS;
s12, collecting 3D images of crops, identifying the types of the crops, and constructing a 3D virtual sand table system containing the crops by combining a 3D electronic sand table of the environment where the crops are located;
s13, inputting relevant trimming parameter information corresponding to the 3D initial standard tree models of the crops at different growth stages;
and S14, respectively displaying images of characters and graphics in the 3D virtual sand table system, displaying the characters in 2D on the same display interface in the 3D virtual sand table system, and displaying crops, fruits and the surrounding environment of the crops in 3D.
Preferably, the 3D virtual sand table system is installed in a server, and the server is in communication connection with the augmented reality terminal, and the method further includes:
displaying the collected crops and the environment images thereof in real time;
acquiring information such as geographical position information, weather, temperature, humidity, soil and the like of the current environment of crops;
identifying crop species;
matching a 3D standard tree model similar to the crop type and the current growth condition and a 3D sand table of a similar environment from a database of various crop and various crop growth environment information in the world of a 3D virtual sand table system, wherein the various crops and various crop growth environment information are stored in advance;
the 3D virtual sand table system demonstrates a crop pruning video;
and prompting a user wearing the AR device to watch the trimmed video through a display screen of the AR device, and guiding the user to perform trimming operation on crops according to the video.
The invention provides a crop pruning demonstration device based on a 3D model, which comprises:
the building module is used for building a 3D virtual sand table system for crop pruning;
the receiving and displaying module is used for receiving growth parameters of the 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
the receiving module is used for receiving a pruning stage and a pruning parameter of a user for pruning the 3D standard tree model;
the judging module is used for judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage;
the display module is used for judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage or not; and displaying the change of the 3D standard tree model after pruning according to the pruning parameters.
The invention provides a 3D model-based crop pruning demonstration system, which comprises a server and the 3D model-based crop pruning demonstration device.
A fourth aspect of the invention provides a storage medium having stored thereon computer program instructions which, when executed by a processor, implement the method of any of the above.
In summary, according to the crop pruning demonstration method, device and system based on the 3D model provided by the invention, the 3D virtual sand table system is adopted to replace the traditional operation teaching mode of physical sand table pruning, the physical sand table does not need to be manufactured, the crop pruning demonstration cost is reduced, the intuition and interactivity of the crop pruning process are improved, and the teaching demonstration cost is saved; and through the growth parameters set by the user, the 3D virtual sand table system automatically calls the built-in material library to generate a 3D standard tree. Virtual trimming operation in different growing periods can be carried out on the 3D standard tree model, and the image of the 3D standard tree model after trimming is displayed by judging whether the trimming parameters meet the trimming parameter standard of the trimming stage corresponding to the growing period of the current crop. Compared with the prior art, the invention has the following beneficial effects:
1. different physical sand tables do not need to be manufactured for different tree types, so that the teaching demonstration cost is saved;
2. the intuition and the interactivity of the crop trimming process are improved;
3. the growth parameters of the 3D sand table system can be set according to the actual position, climate, phenological period, crop variety and the like;
4. crops and varieties needing to be operated can be selected, and the limitation of single variety in the traditional pruning teaching mode is broken through;
5. virtual trimming operation can be performed through the 3D sand table system, and trimming positions and attention points of different trimming stages can be prompted.
Drawings
Fig. 1 shows a flow diagram of a crop pruning demonstration method based on a 3D model according to the present invention.
2-3 show schematic diagrams of 3D model based crop pruning demonstrations of the present invention;
FIG. 4 is a schematic structural diagram of a 3D model-based crop pruning demonstration device according to the present invention;
fig. 5 shows a schematic structural diagram of a crop pruning demonstration device based on a 3D model according to the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Referring to fig. 1, the present invention provides a 3D model-based crop pruning demonstration method, comprising:
s1, constructing a 3D virtual sand table system for crop pruning;
the virtual sand table system refers to a virtual technology in the field of computers, and the basic principle is as follows: a virtual running environment is created according to the real running environment of a computer program, when a certain program tries to play a role, the program can be firstly run in a sand table, and all changes caused by the program in the sand table cannot cause any influence on the real running environment. The sand table can simulate a real operation environment, and the change caused by the operation of the program in the sand table can not cause any influence on the real operation environment.
S11, collecting locus shape data of crops, and constructing a 3D electronic sand table of the region where the crops are located by combining a GIS;
the method mainly comprises the following steps: the method comprises the steps that an unmanned aerial vehicle is used for carrying a binocular camera or a zoom lens to collect images of the terrain where crops are located, colors of satellite remote sensing images are combined, and the landform, three-dimensional coordinates, height, gradient, river, road and surrounding manually-set engineering images of the collected crop terrain are obtained through preset wave band combination and preset time phase selection, wherein the preset wave band combination and the preset time phase are determined by a user according to actual needs;
identifying different objects from the image, and extracting texture feature points of the objects;
and constructing a 3D electronic sand table without crops.
S12, collecting 3D images of crops, identifying the types of the crops, and constructing a 3D virtual sand table system containing the crops by combining a 3D electronic sand table of the environment where the crops are located;
an unmanned aerial vehicle is adopted to carry a binocular camera or a zoom lens to shoot 3D images of crops, the types of the crops are identified, background images and shadow images of the crops in the images are removed according to the illumination intensity and the shooting angle, and the 3D outline shapes of the crops are displayed; of course, the construction of the 3D image of the fruit of the crop is also considered here, and since the fruit is randomly distributed on the 3D contour shape of the crop, the fruit needs to be distinguished from the leaves and branches of the crop (image segmentation technology may be used) and the position of the fruit on the 3D contour shape of the crop needs to be located when constructing; judging the ripeness of fruits, such as oranges, when the fruits are not ripe before picking, the orange color may be lighter, and judging the ripeness of the fruits according to the color. The above locating the position of the fruit on the 3D contour shape of the crop comprises the steps of: after the fruit image is collected, the fruit image is corrected, the fruit image is subjected to image processing, then Hough circle detection is used, 8 characteristic points are selected on the fruit, and the centroid coordinate of the fruit is calculated by adopting a least square method. The Hough circle detection and the least square method adopted in the method belong to algorithms which are common in the field of images, and are mainly characterized in that the combination of the Hough circle detection and the least square method is adopted, so that the accurate fruit shape can be obtained, and if the fruit is elliptical, the fruit is circular. But the position of the fruit on the crop can be more accurately located by finding the center of mass.
The method can be added with a deep learning algorithm to improve the accuracy of the 3D contour shape through continuous training. Here mainly includes: extracting image characteristics of crops and image characteristics of the environment where the crops are located; extracting image features of different crops and image features of the environment where the crops are located for multiple times to form a training set; extracting a training set by adopting a CNN (convolutional neural network) algorithm; then, learning and classifying by using an image classifier; and marking the classified crop characteristics and the environmental characteristics of the crop.
After the position of the fruits on the crops is positioned, collecting growth parameters of the crops at different growth stages;
and constructing a 3D initial standard tree model according to the growth parameters of the crops at each stage and the corresponding 3D outline shape.
S13, inputting relevant trimming parameter information corresponding to the 3D initial standard tree models of the crops in different growth stages, wherein the trimming parameters comprise: positioning information such as branch trimming position, position of the branch to be trimmed, branch trimming length and the like, and inputting information such as attention matters, demonstration animation and the like during trimming.
The crop pruning demonstration method based on the 3D model has the advantages that the 3D virtual sand table system is constructed on the basis of crops in the actual environment, and during demonstration of the interactive link, on one hand, a plurality of cases collected before are stored in the 3D virtual sand table system, and on the other hand, the interactive link is connected with the actual environment of the current crops and the like, so that the interactive link is closer to the actual situation and is more vivid. Moreover, for some farmers, such demonstration is useful for guiding practice.
And S14, respectively displaying images of characters and graphics in the 3D virtual sand table system, displaying the characters in 2D on the same display interface in the 3D virtual sand table system, and displaying crops, fruits and the surrounding environment of the crops in 3D. The text displayed on the display interface generally includes: pruning parameters, or some interactive information of the 3D virtual sand table system operation. The display of the 3D virtual sand table system adopts a 2D/3D fusion display screen. According to the embodiment of the invention, the image part is displayed in a 3D mode, the character part is displayed in a 2D mode, 2D/3D co-fusion display is realized, the dizziness and the discomfort of people for reading 3D characters are overcome, the fidelity of the displayed three-dimensional image is improved, and the user experience is improved.
The above is a detailed description of a 3D virtual sand table system for constructing a crop pruning demonstration method.
S2, receiving growth parameters of the 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
the growth parameters include but are not limited to geographic positions, climate parameters, illumination parameters, crop varieties, phenological periods and other parameters, and a user can input the growth parameters of the 3D virtual sand table system through a user interface. In this step, the generating and displaying the 3D standard tree model according to the growth parameters includes:
and S21, acquiring and updating the 3D material model file corresponding to the growth parameters in the server.
The server stores 3D material model files of different crops; specifically, 3D material modeling can be completed on a standard tree type, a root system, illumination and the like of a crop plant by using an Autodesk3D max tool; uploading the model source files of the '3 ds' material after the modeling is completed to a 3D virtual sand table system management background, and setting data such as crop, variety names, climate parameters and the like corresponding to each model file. After the client of the sand table system is started, the client automatically updates and acquires the material data of the server corresponding to crops, varieties and attributes, and caches the material data to a local hard disk;
s22, analyzing and rendering the 3D material model file into a 3D standard tree model;
the 3D virtual sand table system is internally provided with a 3ds file analysis engine, and can read, analyze and render a 3D model file output by the 3D MAX into a 3D standard tree model. And generating a virtual 3D standard tree model (such as a sugar orange tree model generated by sugar oranges) of the crop variety according with the growth parameters by analyzing and rendering the corresponding 3D model materials, and adjusting the characteristics of the generated 3D standard tree model at different growth stages according to the phenological period.
And S23, displaying the 3D standard tree model in the sand table system working area.
As shown in fig. 2, a 3D standard tree model of sugar oranges at young fruit stage is shown in the sand table system working area.
S3, receiving a pruning stage and pruning parameters of the 3D standard tree model pruned by a user;
wherein the trimming parameters include, but are not limited to, trimming position, trimming size, etc. A corresponding "scissors-shaped" trim logo may be displayed at the trimmed location.
S4, judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage;
in the invention, the trimming parameter standards of each 3D standard tree model in each trimming stage can be pre-stored, and the trimming parameters are compared with the pre-stored trimming parameter standards of the 3D standard tree model in the trimming stage to determine whether the trimming parameters meet the pre-stored trimming parameter standards of the 3D standard tree model in the trimming stage. The pruning stage comprises but is not limited to a young tree pruning stage of less than 1 year, a small tree pruning stage of 1-3 years and a mature tree pruning stage of more than 3 years.
S5, if the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage; and displaying the change of the 3D standard tree model after pruning according to the pruning parameters.
As shown in fig. 3, the pruning parameters conform to the pre-stored pruning parameter standard of the 3D standard tree model in the pruning stage, and after one pruning operation, the change of the pruned 3D standard tree model is displayed according to the pruning parameters.
Specifically, the change of the trimmed 3D standard tree model may be embodied by simultaneously displaying images of the 3D standard tree model before and after trimming in the 3D virtual sand table work area. Furthermore, the trimming operation of the user in one trimming stage can be decomposed into multiple times of trimming, and after the user finishes one-time trimming, images of the 3D standard tree model before and after the trimming are displayed in real time to display the change of the 3D standard tree model after the trimming.
And if the trimming parameters do not accord with the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage, displaying the trimming stage, the trimming parameters and guidance for displaying trimming caution items in a highlight mode at the bottom of a working area of the 3D virtual sand table system, so that a user can correct wrong trimming in time.
In addition, the remote wireless control learning can be realized, the 3D virtual sand table system is installed in the server, a user is connected to the server through a handheld electronic device terminal through a wireless network at a far end, namely a crop pruning site, the user logs in the 3D virtual sand table system remotely to watch pruning demonstration, and meanwhile, the handheld electronic device terminal and the 3D virtual sand table system are used for real-time interaction.
With the great application of the augmented reality technology, the embodiment of the invention can also combine the 3D virtual sand table system with the Augmented Reality (AR) technology, install the 3D virtual sand table system in the server, and then combine with the AR device, and the crop pruning demonstration method based on the 3D model of the invention further comprises the following steps:
displaying the collected crops and the environment images thereof in real time;
acquiring information such as geographical position information, weather, temperature, humidity, soil and the like of the current environment of crops;
identifying crop species;
matching a 3D standard tree model similar to the crop type and the current growth condition and a 3D sand table of a similar environment from a database of various crop and various crop growth environment information in the world of a 3D virtual sand table system, wherein the various crops and various crop growth environment information are stored in advance;
the 3D virtual sand table system demonstrates a crop pruning video;
the user wearing the AR equipment is prompted to watch the trimmed video through the display screen of the AR equipment, and the user is guided to trim crops according to the video, for example, the user can select brand fertilizers to prepare compound fertilizers according to the previous operation in sequence, demonstration is carried out while acquiring on-site fertilizer preparation pictures of the user, if the pictures acquired due to the fact that the fertilizers in the fertilizer preparation pictures are not uniformly mixed are greatly different from the prepared compound fertilizers prestored in the 3D virtual sand table system, the user is prompted to improve the operation until the acquired pictures of the compound fertilizers prepared by the user meet the preset requirements, and therefore the factor that the normal growth of the crops is influenced after trimming due to the fact that the prepared compound fertilizers are not uniform or certain fertilizers are lacked before trimming is eliminated.
And prompting a user wearing the AR device to watch the trimmed video through a display screen of the AR device, and guiding the user to perform trimming operation on crops according to the video. The trimming step is similar to the trimming operation technology in technology, and is to demonstrate a video, collect a user operation image, compare the user operation image with a preset image in a system database, and trim the user according to a correct trimming mode.
According to the crop pruning demonstration method based on the 3D model, the 3D virtual sand table system is adopted to replace the traditional operation teaching mode of physical sand table pruning, a physical sand table does not need to be manufactured, the crop pruning demonstration cost is reduced, the intuition and the interactivity of the crop pruning process are improved, and the teaching demonstration cost is saved; and through the growth parameters set by the user, the 3D virtual sand table system automatically calls the built-in material library to generate a 3D standard tree. Virtual trimming operation in different growing periods can be carried out on the 3D standard tree model, and the image of the 3D standard tree model after trimming is displayed by judging whether the trimming parameters meet the trimming parameter standard of the trimming stage corresponding to the growing period of the current crop. Compared with the prior art, the invention has the following beneficial effects:
1. different physical sand tables do not need to be manufactured for different tree types, so that the teaching demonstration cost is saved;
2. the intuition and the interactivity of the crop trimming process are improved;
3. the growth parameters of the 3D sand table system can be set according to the actual position, climate, phenological period, crop variety and the like;
4. crops and varieties needing to be operated can be selected, and the limitation of single variety in the traditional pruning teaching mode is broken through;
5. virtual trimming operation can be performed through the 3D sand table system, and trimming positions and attention points of different trimming stages can be prompted.
The invention also provides another crop pruning demonstration method based on a 3D model, which is different from the method in the figure 1 in that:
between the steps S2 and S3, the method further comprises:
and S21, displaying the pruning stage of the 3D standard tree model, the pruning parameters of each pruning stage and the attention of each pruning stage.
As shown in fig. 2, if the current pruning stage is a sapling pruning stage of less than 1 year, during the pruning process, a guide such as pruning parameters and cautions such as a current pruning operation program, a pruning position, a pruning size, etc. is prompted at the bottom of the working area of the 3D sand table system.
After the step S5, the method further includes:
s51, storing the history images after each trimming according to the trimming sequence;
specifically, one trimming stage may be divided into multiple trimming, the historical images after each trimming are stored, trimming serial numbers corresponding to the historical images are displayed in a working area of the 3D virtual sand table according to a trimming sequence of each trimming, and when a user clicks any trimming serial number, the historical images corresponding to the trimming serial numbers are displayed.
And S52, when receiving an undo instruction of the user, undoing the last pruning operation on the 3D standard tree model.
As shown in fig. 3, the working area of the 3D virtual sand table system is displayed with: moving, trimming and canceling, wherein the user can cancel the latest picking operation on the 3D standard tree model by clicking a cancel button; and the user clicks the moving button to move the current 3D standard tree type, and after inputting the trimming stage and trimming parameters, the user clicks the trimming button to trim the 3D standard tree type.
S53, recording the trimming stage and the trimming parameters of the user, and inputting the trimming stage and the trimming parameters into a deep learning model for optimization; and when the user logs in again, acquiring and displaying the optimized trimming stage and the trimming parameters.
In the invention, a Google TensorFlow AI framework can be specifically adopted for deep learning and algorithm optimization.
And S54, when the user finishes the operation, storing the 3D standard tree model so as to finish the printing of the 3D standard tree model.
Fig. 4 is a 3D model-based crop pruning demonstration device provided by the present invention, the device comprising:
a construction module 41 for constructing a 3D virtual sand table system for crop pruning;
the receiving and displaying module 42 is configured to receive a growth parameter of the 3D virtual sand table system set by a user, and generate and display a 3D standard tree model according to the growth parameter;
a receiving module 43, configured to receive a pruning stage and a pruning parameter when a user prunes the 3D standard tree model;
a judging module 44, configured to judge whether the pruning parameter meets a pre-stored pruning parameter standard of the 3D standard tree model in the pruning stage;
a display module 45, configured to determine whether the pruning parameter meets a pre-stored pruning parameter standard of the 3D standard tree model in the pruning stage; and displaying the change of the 3D standard tree model after pruning according to the pruning parameters.
In one embodiment, the receiving and displaying module 42 includes:
the acquisition module is used for acquiring and updating the 3D material model file corresponding to the growth parameter in the server; 3D material model files of different crops are stored in the server;
the analysis rendering module is used for analyzing and rendering the 3D material model file into a 3D standard tree model;
and the sub-display module is used for displaying the 3D standard tree model in the sand table system working area.
And the second display module is used for displaying the pruning stages of the 3D standard tree model, the pruning parameters of each pruning stage and the attention items of each pruning stage.
And the storage module is used for storing the history images after each trimming according to the trimming sequence.
And the cancelling module is used for cancelling the last pruning operation on the 3D standard tree model when receiving a cancelling instruction of a user.
The deep learning module is used for recording the pruning stage and the pruning parameters of the user and inputting the pruning stage and the pruning parameters into a deep learning model for optimization;
and the third display module is used for acquiring and displaying the optimized trimming stage and the optimized trimming parameters when the user logs in again.
And the second storage module is used for storing the 3D standard tree model when the user finishes the operation so as to finish the printing of the 3D standard tree model.
The invention also provides a crop pruning demonstration system based on the 3D model, and the system comprises a server and any one of the crop pruning demonstration devices based on the 3D model.
In addition, the 3D model-based crop pruning demonstration method according to the embodiment of the present invention described in conjunction with fig. 1 may be implemented by a 3D model-based crop pruning demonstration device. Fig. 5 is a schematic diagram illustrating a hardware structure of a 3D model-based crop pruning demonstration device according to an embodiment of the present invention.
The 3D model based crop cropping presentation device may comprise at least one processor 401, at least one memory 402 and computer program instructions stored in the memory 402 which, when executed by the processor 401, implement the method of the present embodiment.
Specifically, the processor 401 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing embodiments of the present invention.
The processor 401 reads and executes the computer program instructions stored in the memory 402 to implement the 3D model-based crop cropping demonstration method in the above-described embodiment.
In one example, the 3D model-based crop cropping presentation device may also include a communication interface 403 and a bus 410. As shown in fig. 5, the processor 401, the memory 402, and the communication interface 403 are connected via a bus 410 to complete communication therebetween.
The communication interface 403 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiments of the present invention.
The bus 410 may include one or more buses, although specific buses are described and illustrated herein, the invention contemplates any suitable buses or interconnects, including, by way of example and not limitation, Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), HyperTransport (HT) interconnect, Industry Standard Architecture (ISA) bus, InfiniBand interconnect, Low Pin number (L PC) bus, memory bus, Micro Channel Architecture (MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (SATA) bus, video electronics standards Association local (V L B) bus, or other suitable bus, or combinations of two or more of these.
In addition, in combination with the crop pruning demonstration method based on the 3D model in the above embodiments, the embodiments of the present invention may be implemented by providing a computer-readable storage medium. The computer readable storage medium having stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the 3D model-based crop pruning demonstration methods of the above embodiments.
In summary, according to the crop pruning demonstration method, device and system based on the 3D model provided by the invention, the 3D virtual sand table system is adopted to replace the traditional operation teaching mode of physical sand table pruning, the physical sand table does not need to be manufactured, the crop pruning demonstration cost is reduced, the intuition and interactivity of the crop pruning process are improved, and the teaching demonstration cost is saved; and through the growth parameters set by the user, the 3D virtual sand table system automatically calls the built-in material library to generate a 3D standard tree. Virtual trimming operation in different growing periods can be carried out on the 3D standard tree model, and the image of the 3D standard tree model after trimming is displayed by judging whether the trimming parameters meet the trimming parameter standard of the trimming stage corresponding to the growing period of the current crop. Compared with the prior art, the invention has the following beneficial effects:
1. different physical sand tables do not need to be manufactured for different tree types, so that the teaching demonstration cost is saved;
2. the intuition and the interactivity of the crop trimming process are improved;
3. the growth parameters of the 3D sand table system can be set according to the actual position, climate, phenological period, crop variety and the like;
4. crops and varieties needing to be operated can be selected, and the limitation of single variety in the traditional pruning teaching mode is broken through;
5. virtual trimming operation can be performed through the 3D sand table system, and trimming positions and attention points of different trimming stages can be prompted.
It is to be understood that the invention is not limited to the specific arrangements and instrumentality described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present invention.
The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
As described above, only the specific embodiments of the present invention are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present invention, and these modifications or substitutions should be covered within the scope of the present invention.
Claims (10)
1. The crop pruning demonstration method based on the 3D model is characterized by comprising the following steps:
constructing a 3D virtual sand table system for crop pruning;
receiving growth parameters of a 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
receiving a pruning stage and pruning parameters of a user for pruning the 3D standard tree model;
judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage;
if the pruning parameter accords with the pre-stored pruning parameter standard of the 3D standard tree model in the pruning stage; and displaying the change of the 3D standard tree model after pruning according to the pruning parameters.
2. The 3D model-based crop pruning demonstration method according to claim 1, wherein the generating and displaying a virtual 3D standard tree model according to the growth parameters comprises:
acquiring and updating the 3D material model file corresponding to the growth parameter in a server; 3D material model files of different crops are stored in the server;
analyzing and rendering the 3D material model file into a 3D standard tree model;
and displaying the 3D standard tree model in the sand table system working area.
3. The 3D model-based crop pruning demonstration method according to claim 2, wherein before receiving the pruning stage and pruning parameters of the 3D standard tree model pruned by the user, the method further comprises:
and displaying the pruning stages of the 3D standard tree model, the pruning parameters of each pruning stage and the attention items of each pruning stage.
4. The 3D model-based crop cropping demonstration method of claim 3, further comprising:
storing the history images after each trimming according to the trimming sequence;
and when an undo instruction of a user is received, undoing the last pruning operation on the 3D standard tree model.
5. The 3D model-based crop cropping demonstration method of claim 4, further comprising:
recording a trimming stage and trimming parameters of a user, and inputting the trimming stage and the trimming parameters into a deep learning model for optimization;
and when the user logs in again, acquiring and displaying the optimized trimming stage and the trimming parameters.
6. The 3D model-based crop pruning demonstration method according to any one of claims 1 to 5, wherein the constructing of the 3D virtual crop pruning sand table system comprises:
s11, collecting locus shape data of crops, and constructing a 3D electronic sand table of the region where the crops are located by combining a GIS;
s12, collecting 3D images of crops, identifying the types of the crops, and constructing a 3D virtual sand table system containing the crops by combining a 3D electronic sand table of the environment where the crops are located;
s13, inputting relevant trimming parameter information corresponding to the 3D initial standard tree models of the crops at different growth stages;
and S14, respectively displaying images of characters and graphics in the 3D virtual sand table system, displaying the characters in 2D on the same display interface in the 3D virtual sand table system, and displaying crops, fruits and the surrounding environment of the crops in 3D.
7. The 3D model-based crop cropping demonstration method according to any one of claims 1 to 5, wherein the 3D virtual sand table system is installed in a server, and the server is in communication connection with an augmented reality terminal, and the method further comprises:
displaying the collected crops and the environment images thereof in real time;
acquiring information such as geographical position information, weather, temperature, humidity, soil and the like of the current environment of crops;
identifying crop species;
matching a 3D standard tree model similar to the crop type and the current growth condition and a 3D sand table of a similar environment from a database of various crop and various crop growth environment information in the world of a 3D virtual sand table system, wherein the various crops and various crop growth environment information are stored in advance;
the 3D virtual sand table system demonstrates a crop pruning video;
and prompting a user wearing the AR device to watch the trimmed video through a display screen of the AR device, and guiding the user to perform trimming operation on crops according to the video.
8. A crop cropping demonstration device based on a 3D model, said device comprising:
the building module is used for building a 3D virtual sand table system for crop pruning;
the receiving and displaying module is used for receiving growth parameters of the 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
the receiving module is used for receiving a pruning stage and a pruning parameter of a user for pruning the 3D standard tree model;
the judging module is used for judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage;
the display module is used for judging whether the trimming parameters meet the pre-stored trimming parameter standard of the 3D standard tree model in the trimming stage or not; and displaying the change of the 3D standard tree model after pruning according to the pruning parameters.
9. A 3D model based crop cropping demonstration system comprising a server and a 3D model based crop cropping demonstration apparatus as claimed in claim 8.
10. A storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010212189.6A CN111508078A (en) | 2020-03-24 | 2020-03-24 | Crop pruning demonstration method, device and system based on 3D model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010212189.6A CN111508078A (en) | 2020-03-24 | 2020-03-24 | Crop pruning demonstration method, device and system based on 3D model |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111508078A true CN111508078A (en) | 2020-08-07 |
Family
ID=71864662
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010212189.6A Pending CN111508078A (en) | 2020-03-24 | 2020-03-24 | Crop pruning demonstration method, device and system based on 3D model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111508078A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117546691A (en) * | 2023-10-19 | 2024-02-13 | 廊坊市园林绿化事务中心 | Intelligent garden tree pruning system and method based on image recognition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184569A (en) * | 2011-06-11 | 2011-09-14 | 福州大学 | Individual plant wood modeling method driven by domain ontology |
| CN102222442A (en) * | 2011-03-24 | 2011-10-19 | 北京农业信息技术研究中心 | Cyme growth simulation method and simulation system |
| CN104850226A (en) * | 2015-04-30 | 2015-08-19 | 北京农业信息技术研究中心 | Three-dimensional interactive fruit tree shape trimming method based on gesture recognition |
| CN108834621A (en) * | 2018-05-23 | 2018-11-20 | 西安工业大学 | A kind of flowers and plants pruning method and clipping device |
| CN108986229A (en) * | 2018-07-11 | 2018-12-11 | 苏州昭轩数字科技有限公司 | A kind of augmented reality pruning method and its equipment based on artificial intelligence |
-
2020
- 2020-03-24 CN CN202010212189.6A patent/CN111508078A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102222442A (en) * | 2011-03-24 | 2011-10-19 | 北京农业信息技术研究中心 | Cyme growth simulation method and simulation system |
| CN102184569A (en) * | 2011-06-11 | 2011-09-14 | 福州大学 | Individual plant wood modeling method driven by domain ontology |
| CN104850226A (en) * | 2015-04-30 | 2015-08-19 | 北京农业信息技术研究中心 | Three-dimensional interactive fruit tree shape trimming method based on gesture recognition |
| CN108834621A (en) * | 2018-05-23 | 2018-11-20 | 西安工业大学 | A kind of flowers and plants pruning method and clipping device |
| CN108986229A (en) * | 2018-07-11 | 2018-12-11 | 苏州昭轩数字科技有限公司 | A kind of augmented reality pruning method and its equipment based on artificial intelligence |
Non-Patent Citations (4)
| Title |
|---|
| 吕萌萌 等: "基于Unity 3D果树交互虚拟修剪技术及其实现", no. 4, pages 7 - 11 * |
| 周俊 等: "基于立体视觉的水果采摘机器人系统设计", 《农业机械学报》, vol. 41, no. 6, pages 158 - 161 * |
| 田世平 等: "模拟果树修剪系统研究", no. 2, pages 32 - 34 * |
| 胡国顺 等: "基于单片机和智能监测的采摘机器人调速系统设计", 《农机化研究》, no. 9, pages 83 - 86 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117546691A (en) * | 2023-10-19 | 2024-02-13 | 廊坊市园林绿化事务中心 | Intelligent garden tree pruning system and method based on image recognition |
| CN117546691B (en) * | 2023-10-19 | 2024-04-19 | 廊坊市园林绿化事务中心 | Intelligent garden tree pruning system and method based on image recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11935282B2 (en) | Server of crop growth stage determination system, growth stage determination method, and storage medium storing program | |
| CN109117811A (en) | A kind of system and method based on low-altitude remote sensing measuring technique estimation urban vegetation coverage rate | |
| Underwood et al. | Lidar‐based tree recognition and platform localization in orchards | |
| CN107807540A (en) | A kind of agriculture intelligent platform based on image procossing | |
| CN103430170B (en) | Operate auxiliary program and operation servicing unit | |
| De Castro et al. | High-throughput system for the early quantification of major architectural traits in olive breeding trials using UAV images and OBIA techniques | |
| CN108633533A (en) | The automatic Tending methods of trees, device, electronic equipment and storage medium | |
| Röder et al. | Application of optical unmanned aerial vehicle-based imagery for the inventory of natural regeneration and standing deadwood in post-disturbed spruce forests | |
| CN113177942A (en) | Soybean planting area remote sensing monitoring and identifying method and device, electronic equipment and medium | |
| Zermas et al. | Extracting phenotypic characteristics of corn crops through the use of reconstructed 3D models | |
| CN111552762A (en) | Orchard planting digital map management method and system based on fruit tree coding | |
| CN111508078A (en) | Crop pruning demonstration method, device and system based on 3D model | |
| CN108122224B (en) | System for measuring crown canopy density | |
| CN113435345A (en) | Growth stage determination method and device, agricultural system, equipment and storage medium | |
| US20220189329A1 (en) | System and method for assisting with the pruning of plants | |
| CN111582035B (en) | Fruit tree age identification method, device, equipment and storage medium | |
| CN115797764B (en) | Remote sensing big data interpretation method and system applied to farmland non-agrochemical monitoring | |
| CN111508059B (en) | Crop picking demonstration method, device, system and medium based on 3D model | |
| CN112036313A (en) | Tobacco planting area detection method, device and equipment and readable storage medium | |
| CN115294472A (en) | Fruit yield estimation method, model training method, equipment and storage medium | |
| CN111508060A (en) | Crop fertilization and pesticide application demonstration method, device and system based on 3D model | |
| Ed-daoudi et al. | A Predictive Approach to Improving Agricultural Productivity in Morocco through Crop Recommendations | |
| Marreiros et al. | Progress in Artificial Intelligence: 20th EPIA Conference on Artificial Intelligence, EPIA 2021, Virtual Event, September 7–9, 2021, Proceedings | |
| CN110738133B (en) | Method and device for identifying image contour boundaries of different agricultural facilities | |
| Miller | Estimation of individual tree metrics using structure-from-motion photogrammetry. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |