CN116070997A - Logistics warehouse management method and system based on virtual reality - Google Patents
Logistics warehouse management method and system based on virtual reality Download PDFInfo
- Publication number
- CN116070997A CN116070997A CN202310114727.1A CN202310114727A CN116070997A CN 116070997 A CN116070997 A CN 116070997A CN 202310114727 A CN202310114727 A CN 202310114727A CN 116070997 A CN116070997 A CN 116070997A
- Authority
- CN
- China
- Prior art keywords
- warehouse
- virtual reality
- logistics
- information
- logistics warehouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000007726 management method Methods 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 13
- 239000011521 glass Substances 0.000 claims description 23
- 238000004422 calculation algorithm Methods 0.000 claims description 14
- 238000004891 communication Methods 0.000 claims description 9
- 238000013461 design Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 5
- 238000003709 image segmentation Methods 0.000 claims description 4
- 238000004088 simulation Methods 0.000 abstract description 19
- 238000009877 rendering Methods 0.000 abstract description 6
- 230000003287 optical effect Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000013507 mapping Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000004927 fusion Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The invention provides a logistics warehouse management method and system based on virtual reality, and relates to the field of logistics warehouse management. According to the method, a virtual reality model of the logistics warehouse is generated based on the collected arrangement information of the logistics warehouse and is stored in a management end, the virtual reality model of the logistics warehouse is loaded into preset virtual reality terminal equipment for projection and rendering when the logistics warehouse is in warehouse-out or warehouse-in operation, a realistic logistics warehouse three-dimensional simulation environment is obtained, the object position of the object in warehouse-out or warehouse-in storage is positioned in the logistics warehouse three-dimensional simulation environment according to the information of the object in warehouse-out or warehouse-in, an optimal path is planned, the virtual reality terminal equipment and the logistics warehouse three-dimensional simulation environment provide accurate positioning navigation for workers, workers are prevented from getting lost in the complex logistics warehouse, the workers can conveniently and rapidly and accurately find the object position of the object goods for shipment or the object position of the object storage for warehouse-in operation, and the warehouse-out or warehouse-in operation efficiency of the workers of the logistics warehouse is improved.
Description
Technical Field
The invention relates to the technical field of logistics warehouse management, in particular to a logistics warehouse management method and system based on virtual reality.
Background
The logistics refers to a process of organically combining functions of transportation, storage, loading, unloading, carrying, packaging, circulation processing, distribution, information processing and the like according to actual needs in the process of enabling the articles to flow from a supply place to a receiving place. With the rapid development of electronic commerce, online shopping is rising, the logistics industry is larger and larger in scale, and a large amount of goods need to be stored in a warehouse in a centralized manner, wherein the warehouse is a necessary facility for serving manufacturers, commodity suppliers and logistics organizations. The logistics warehouse consists of a warehouse for storing articles, a transportation and conveying facility, conveying pipelines and equipment for entering and exiting the warehouse, a fire-fighting facility, a management room and the like, the structure is complex, in the conventional logistics warehouse management, the links of warehousing, management, ex-warehouse and the like of goods are still completed manually, the warehouse management is mostly manually operated, and the management efficiency of the logistics warehouse is low due to the fact that the warehouse management is easy to operate confusion under the conditions that the warehouse is complex and the quantity of goods and staff is large.
Disclosure of Invention
The invention aims to provide a logistics warehouse management method based on virtual reality, which is characterized in that a virtual reality model of a logistics warehouse is generated in advance based on collected arrangement information of the logistics warehouse and is stored in a management end, the virtual reality model of the logistics warehouse is loaded into preset virtual reality terminal equipment for projection and rendering during warehouse-out or warehouse-in operation, a realistic logistics warehouse three-dimensional simulation environment is obtained, a target position for article warehouse-out or warehouse-in storage is positioned in the logistics warehouse three-dimensional simulation environment according to article information of the warehouse-out or warehouse-in, an optimal path is planned, and finally accurate positioning navigation is provided for workers through the virtual reality terminal equipment and the logistics warehouse three-dimensional simulation environment, so that the workers are prevented from being confused and lost in the complex logistics warehouse, and are convenient for the workers to quickly and accurately find out target goods or position the target position for article storage for warehouse-in, and accordingly, the warehouse-out or warehouse-in operation efficiency of the logistics warehouse workers is improved.
Embodiments of the present invention are implemented as follows:
in a first aspect, an embodiment of the present application provides a logistic warehouse management method based on virtual reality, including:
collecting arrangement information of a logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information, and storing the virtual reality model at a management end;
during warehousing operation, acquiring information of a warehousing object through preset virtual reality terminal equipment, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehousing path of the warehousing object in the virtual reality model based on the information of the warehousing object;
during the ex-warehouse operation, acquiring information of the ex-warehouse articles through a preset virtual reality terminal device, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse articles in the virtual reality model based on the information of the ex-warehouse articles;
and according to the position of the warehouse-in article or the warehouse-out article in the virtual reality model and the warehouse-out or warehouse-in path, carrying out navigation positioning on the warehouse-out or warehouse-in operation in the logistics warehouse through the preset virtual reality terminal equipment, and realizing the warehouse-out or warehouse-in operation of the article.
In some embodiments of the invention, the collecting the placement information of the logistics warehouse comprises: acquiring image information of the logistics warehouse through a panoramic camera and fusing the image information into a two-dimensional arrangement panoramic image of the logistics warehouse; or obtaining plane and three-dimensional design drawings of the logistics warehouse.
In some embodiments of the invention, the generating a virtual reality model of a logistics warehouse in advance based on the arrangement information comprises:
converting the two-dimensional arrangement panorama of the logistics warehouse into a three-dimensional virtual reality model of the logistics warehouse through an image segmentation algorithm and a depth estimation algorithm; or (b)
And constructing a three-dimensional virtual reality model of the logistics warehouse by using three-dimensional modeling software based on the acquired plane and three-dimensional design drawing of the logistics warehouse.
In some embodiments of the present invention, the virtual reality terminal device includes VR glasses and/or AR glasses, and the VR glasses and/or AR glasses include an information scanning module and a voice recognition and broadcasting module.
In some embodiments of the present invention, the virtual reality terminal device and the management end are in communication connection through the internet of things or a satellite.
In a second aspect, an embodiment of the present application provides a logistic warehouse management system based on virtual reality, including:
the system comprises an acquisition and generation module, a management end and a storage end, wherein the acquisition and generation module is used for acquiring arrangement information of the logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information and storing the virtual reality model at the management end;
the first loading and determining module is used for acquiring information of the warehouse-in articles through a preset virtual reality terminal device during warehouse-in operation, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehouse-in path of the warehouse-in articles in the virtual reality model based on the information of the warehouse-in articles;
the second loading and determining module is used for acquiring information of the ex-warehouse objects through a preset virtual reality terminal device during ex-warehouse operation, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse objects in the virtual reality model based on the information of the ex-warehouse objects;
the navigation positioning module is used for performing navigation positioning on the ex-warehouse or the in-warehouse operation in the logistics warehouse through the preset virtual reality terminal equipment according to the position of the in-warehouse article or the ex-warehouse article in the virtual reality model and the ex-warehouse or in-warehouse path, so as to realize the ex-warehouse or in-warehouse operation of the article.
In a third aspect, embodiments of the present application provide an electronic device comprising at least one processor, at least one memory, and a data bus; wherein: the processor and the memory complete communication with each other through the data bus; the memory stores program instructions for execution by the processor, the processor invoking the program instructions to perform the method of any of the first aspects.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of the first aspects.
Compared with the prior art, the embodiment of the invention has at least the following advantages or beneficial effects:
the embodiment of the invention provides a logistics warehouse management method based on virtual reality, which is characterized in that a virtual reality model of a logistics warehouse is generated in advance based on arrangement information of the collected logistics warehouse and is stored in a management end, the virtual reality model of the logistics warehouse is loaded into preset virtual reality terminal equipment for projection and rendering during the warehouse-out or warehouse-in operation, a realistic logistics warehouse three-dimensional simulation environment is obtained, a target position for article warehouse-out or warehouse-in storage is positioned in the logistics warehouse three-dimensional simulation environment according to article information of the warehouse-out or warehouse-in, an optimal path is planned, and finally accurate positioning navigation is provided for workers through the virtual reality terminal equipment and the logistics warehouse three-dimensional simulation environment, so that the workers are prevented from being confused and lost in the complicated logistics warehouse, and are convenient for the workers to quickly and accurately find out target goods for the warehouse-out or to position the target position for the goods storage for warehouse-in operation, thereby improving the efficiency of the warehouse-out or warehouse-in operation of the logistics warehouse workers.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of an embodiment of a virtual reality-based logistics warehouse management method in accordance with the present invention;
FIG. 2 is a flowchart of steps for collecting placement information for a logistics warehouse in accordance with an embodiment of the present invention;
FIG. 3 is a flowchart of steps for pre-generating a virtual reality model of a logistics warehouse based on placement information in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a functional module of a virtual reality terminal device in an embodiment of the present invention;
FIG. 5 is a block diagram illustrating an embodiment of a virtual reality-based logistics warehouse management system in accordance with the present invention;
fig. 6 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations.
Example 1
Referring to fig. 1-3, an embodiment of the present application provides a logistics warehouse management method based on virtual reality, which generates a virtual reality model of a logistics warehouse in advance based on collected layout information of the logistics warehouse and stores the virtual reality model in a management end, loads the virtual reality model of the logistics warehouse into a preset virtual reality terminal device for projection and rendering during a warehouse-out or warehouse-in operation, obtains a realistic logistics warehouse three-dimensional simulation environment, locates a target position of article warehouse-out or warehouse-in storage in the logistics warehouse three-dimensional simulation environment according to article information of the warehouse-out or warehouse-in, and plans an optimal path, and finally provides accurate positioning navigation for a worker through the virtual reality terminal device and the logistics warehouse three-dimensional simulation environment, so as to prevent the worker from being confused and lost in a complex logistics warehouse, and facilitate the worker to quickly and accurately find out a target cargo for the warehouse-out or the target position of the article-in storage for warehouse-in operation, thereby improving the efficiency of the warehouse-out or warehouse-in operation of the logistics warehouse worker.
As shown in fig. 1, the above-mentioned logistics warehouse management method based on virtual reality includes the following steps:
step S101: and collecting arrangement information of the logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information, and storing the virtual reality model at a management end.
In the above steps, as shown in fig. 2, collecting the arrangement information of the logistics warehouse includes:
step S201: acquiring image information of the logistics warehouse through a panoramic camera and fusing the image information into a two-dimensional arrangement panoramic image of the logistics warehouse; or (b)
Step S202: and obtaining the plane and three-dimensional design drawing of the logistics warehouse.
The panoramic camera can acquire the whole and partial image information of the logistics warehouse by adopting an insta360 one panoramic camera, and then the acquired image information is spliced and fused according to the requirements according to the levels to obtain a two-dimensional arrangement panoramic image of the logistics warehouse, such as a two-dimensional arrangement panoramic image of the whole level of the logistics warehouse, a two-dimensional arrangement panoramic image of a subarea level, a two-dimensional arrangement panoramic image of a certain partial (such as a shelf) level, and the like; or obtaining plane and three-dimensional design drawings of the logistics warehouse, such as CAD drawings, BIM model drawings and the like. The panorama can be obtained by splicing and fusing the following steps: 1. selecting a mapping model, wherein the mapping model is a geometric figure, such as a sphere, a cylindrical surface and the like, obtained by pasting the acquired image; 2. extracting characteristic points of the acquired images, and matching the characteristic points of the images through characteristic matching algorithms such as surf, sift and the like to obtain a mapping relation between the images on a mapping model; 3. performing Warp transformation on the image according to the mapping relation, and aligning the image; 4. color difference among images is eliminated by utilizing a Reinhard algorithm, image fusion is realized by adopting a Laplacian pyramid Laplacian pyramid algorithm to eliminate the seam, specifically, firstly, gaussian pyramids Gi and Gi+1 of two images are established, and then, laplacian pyramids with a certain layer number are established, wherein the Laplacian pyramids with a certain layer number are established as follows:
where Gi denotes the gaussian image of the i-th layer, gi+1 denotes the gaussian image of the i+1-th layer, up denotes the Up-sampling mapping of the pixel with position (x, y) in the source image to the (2x+1, 2y+1) position of the target image,
used to represent convolution, k5×5 represents the gaussian kernel of 5*5; carrying out mask weighted addition on the images of the Laplacian pyramid, wherein the added result is a new pyramid; and finally reconstructing a final fusion image according to the new pyramid. The higher the layer number of the Laplacian pyramid is, the better the image fusion effect is, and the smoother the obtained panoramic image is, the higher the quality is.
Further, as shown in fig. 3, the step of generating the virtual reality model of the logistics warehouse in advance based on the arrangement information includes:
step S301: converting the two-dimensional arrangement panorama of the logistics warehouse into a three-dimensional virtual reality model of the logistics warehouse through an image segmentation algorithm and a depth estimation algorithm; or (b)
Step S302: and constructing a three-dimensional virtual reality model of the logistics warehouse by using three-dimensional modeling software based on the acquired plane and three-dimensional design drawing of the logistics warehouse.
In the above steps, the image segmentation algorithm may use a conventional image processing method, such as threshold segmentation, edge segmentation, region growing, and the like; the depth estimation algorithm can be implemented by using a neural network model constructed based on a wavelet decomposition algorithm, and comprises the following specific steps:
1: decomposing an input single image into a low-frequency subband and three high-frequency subbands by utilizing wavelet decomposition of the image, and further decomposing the low frequency subband to obtain a multi-level wavelet decomposed high-frequency subband and a multi-level wavelet decomposed low-frequency subband;
2: inputting the image into a depth estimation network, and integrating the high-frequency sub-bands obtained in the step 1 into a decoder of the network to obtain a depth map of the image;
3: inputting the front and rear frames in the video into a pose estimation network, and estimating the corresponding camera pose;
4: inputting the front and rear frame images input in the step 3 into an optical flow network, estimating the optical flow of the front and rear frames, and generating a mask of an image shielding area; the specific process of the step 4 is as follows: adding an optical flow estimation network in a network frame to generate an optical flow, processing pixel shielding at the same time, and processing shielding pixels in the loss calculation by using a shade; wherein, the input of the network: firstly, inputting a network into a network encoder for optical flow estimation, wherein the encoder part is provided with 6 layers of convolution layers, and finally, the characteristics f1 and f2 corresponding to two frames of images are respectively obtained; and then calculating a correlation coefficient for the obtained characteristics, wherein the specific formula is as follows: c (x 1, x 2) = Σoe [ -k, k ] × [ -k, k ] < f1 (x1+o), f2 (x2+o) >, wherein f1, f2 are two feature maps, comparing image blocks with f1 centered on x1 and f2 centered on x2 and k as the size, obtaining global correlation coefficients by calculating the correlation coefficients of all the image blocks in the two feature maps; the input of the decoder part of the network is the correlation coefficient calculated before, the decoder part has 6 convolution layers in total, the optical flow and the shade of the original image size are obtained through 6 times of up-sampling, each convolution layer can generate an optical flow estimation result and a shade, and the optical flow estimation result and the shade are input into the next layer after up-sampling, the correlation coefficient is calculated once before each layer of input of the decoder, except the first layer, each layer after the first layer can combine the optical flow to perform one deformation convolution and multiply the shade when calculating the correlation coefficient, and the finally obtained shade is subjected to a binarization processing for removing the shielding area in the image reconstruction;
5: the current frame image, the depth image of the image obtained in the step 2 and the camera pose obtained in the step 3 are utilized, and the image of the target frame is synthesized in a bilinear interpolation mode;
6: training a network in a counter-propagation mode by utilizing the composite image and the original image obtained in the step 5 and the mask calculation loss obtained in the step 4; the loss includes a reprojection loss, and the calculation formula is as follows:
L rep ＝(αL SSIM +(1-α)||I t1 -I t0→t1 || 1 )*mask
the value of α is generally 0.85, it0→t1 represents the synthesized target frame, it1 represents the far image of the target frame, and i 1 represents the L1 paradigm. SSIM is the structural similarity between two images, and is an index for measuring the similarity of the two images;
7: and 6, finishing training the network through multiple iterations, and inputting a single picture into the trained network to obtain a depth map of a corresponding image, wherein the depth map comprises depth information of each object in the image.
The two-dimensional arrangement panorama of the logistics warehouse can be divided into images with different levels and different sizes through an image division algorithm, then the depth information of each object in each image is calculated by combining a depth estimation algorithm model, namely, the two-dimensional arrangement panorama of the logistics warehouse can be converted into a high-precision three-dimensional virtual reality model with parallax and stored in a management end; the obtained plane and three-dimensional design drawing of the logistics warehouse, such as CAD drawing and BIM model drawing, can be subjected to 3D modeling through three-dimensional modeling processing software such as units 3D, UE to construct a logistics warehouse virtual scene, and a three-dimensional virtual reality model of the logistics warehouse is obtained and stored at a management end. Based on the three-dimensional virtual reality model stored in the management end, warehouse staff can conveniently and accurately present and interact locally by loading the model through the virtual reality terminal equipment, so that the warehouse staff can be placed in a realistic warehouse simulation environment in advance, and the warehouse environment can be accurately perceived by the staff to make a correct action decision.
Step S102: during warehousing operation, acquiring information of a warehousing object through preset virtual reality terminal equipment, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehousing path of the warehousing object in the virtual reality model based on the information of the warehousing object;
step S103: during the ex-warehouse operation, acquiring information of the ex-warehouse articles through a preset virtual reality terminal device, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse articles in the virtual reality model based on the information of the ex-warehouse articles;
step S104: and according to the position of the warehouse-in article or the warehouse-out article in the virtual reality model and the warehouse-out or warehouse-in path, carrying out navigation positioning on the warehouse-out or warehouse-in operation in the logistics warehouse through the preset virtual reality terminal equipment, and realizing the warehouse-out or warehouse-in operation of the article.
In the above steps, the virtual reality terminal device includes, but is not limited to, VR glasses and/or AR glasses, and the virtual reality terminal device may also be integrated into an information scanning module, a voice recognition and broadcasting module, a networking module, a path planning navigation module, and the like based on the VR glasses and/or the AR glasses, as shown in fig. 4. When the logistics warehouse needs to carry out warehousing operation on articles, a scanning module of VR glasses or AR glasses which can be worn by a worker scans two-dimensional codes or bar codes on the articles to be warehoused, related information of the articles to be warehoused, such as names, numbers, types, attribution information, time nodes of transportation and warehousing time and the like, of the articles can be acquired and uploaded and stored at a management end during warehousing so as to be convenient for management, then a three-dimensional virtual reality model of the logistics warehouse at the management end is loaded to the VR glasses or the AR glasses to carry out projection and rendering, a realistic three-dimensional simulation environment of the logistics warehouse is obtained, a target area and a specific position (such as a shelf number) where the articles should be stored are determined in the three-dimensional simulation environment of the logistics warehouse based on the related information of the articles to be warehoused, an optimal warehousing path is planned for the worker based on the determined position of the articles to be warehoused, and the voice navigation and positioning can be carried out for the worker through a voice recognition and broadcasting module, information such as the position path of the worker and the target area is presented in real time in the three-dimensional simulation environment of the logistics warehouse, the surrounding information, the distance and the path of the target position and the like are prevented from being confused by the worker and the worker, the positioning the worker and the position of the worker can be convenient for the worker to quickly find the objects to store the articles in the logistics warehouse, and the target position can be fast, and the position of the logistics warehouse can be convenient to be stored.
Similarly, when the logistics warehouse needs to carry out the warehouse-out operation, a worker can recognize the voice of a commodity-taking customer through a voice recognition and broadcasting module of the worn VR glasses or AR glasses or scan the commodity-taking code of the customer through a scanning module of the glasses, relevant information of the commodity to be delivered is obtained, then a three-dimensional virtual reality model of the logistics warehouse at a management end is loaded to the VR glasses or the AR glasses to be projected and rendered, a realistic three-dimensional logistics warehouse simulation environment is obtained, an area and a specific position (such as a shelf number) of the commodity storage are determined in the three-dimensional logistics warehouse simulation environment based on the relevant information of the commodity to be delivered, an optimal warehouse-out path is planned for the worker based on the determined position of the commodity storage area, and information such as the position path of the worker and a target area can be broadcast in real time through voice recognition and broadcasting, information such as surrounding things, distance from the target position and the path are displayed in real time in the three-dimensional logistics warehouse simulation environment, the worker is prevented from being in a complex warehouse, the worker can conveniently and accurately find the target commodity to be delivered, and the work efficiency of the logistics warehouse is improved.
It is worth mentioning that above-mentioned virtual reality terminal equipment carries out communication connection through thing networking or satellite with the management end, and the virtual reality terminal equipment of being convenient for loads the virtual reality model of commodity circulation warehouse to local from the management end for the rendering and the response speed of model promote user experience sense. The internet of things can be realized through wireless communication technologies such as Bluetooth, wifi, zigbee or 5G, and satellite communication can be realized by a Beidou satellite system or a GNSS (Global Navigation Satellite System) global navigation satellite system. The VR glasses and/or the AR glasses of the virtual reality terminal equipment can be interconnected and intercommunicated through the Internet of things or satellites, so that efficient communication between logistics warehouse workers is facilitated, and the working efficiency is further improved.
It should be noted that, in the embodiment of the present invention, the technical content that is not specifically described in the embodiment of the present invention may be implemented by using the existing related technology, which belongs to the prior art, and is not described in detail in the embodiment of the present invention.
Example 2
Accordingly, referring to fig. 5, an embodiment of the present application provides a logistics warehouse management system based on virtual reality, including:
the system comprises an acquisition and generation module 1, a management end and a control end, wherein the acquisition and generation module 1 is used for acquiring arrangement information of a logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information and storing the virtual reality model at the management end; the first loading and determining module 2 is used for acquiring information of the warehouse-in articles through a preset virtual reality terminal device during warehouse-in operation, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehouse-in path of the warehouse-in articles in the virtual reality model based on the information of the warehouse-in articles; the second loading and determining module 3 is used for acquiring information of the ex-warehouse objects through a preset virtual reality terminal device during ex-warehouse operation, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse objects in the virtual reality model based on the information of the ex-warehouse objects; the navigation positioning module 4 is used for performing navigation positioning on the ex-warehouse or the in-warehouse operation in the logistics warehouse through the preset virtual reality terminal equipment according to the position of the in-warehouse article or the ex-warehouse article in the virtual reality model and the ex-warehouse or the in-warehouse path, so as to realize the ex-warehouse or the in-warehouse operation of the article.
The specific implementation process of the above system refers to the logistics warehouse management method based on virtual reality provided in embodiment 1, and will not be described herein.
Example 3
Referring to fig. 6, an embodiment of the present application provides an electronic device comprising at least one processor 5, at least one memory 6 and a data bus 7; wherein: the processor 5 and the memory 6 complete the communication with each other through the data bus 7; the memory 6 stores program instructions executable by the processor 5, the processor 5 invoking the program instructions to perform a geographic information data acquisition processing method. For example, implementation:
collecting arrangement information of a logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information, and storing the virtual reality model at a management end; during warehousing operation, acquiring information of a warehousing object through preset virtual reality terminal equipment, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehousing path of the warehousing object in the virtual reality model based on the information of the warehousing object; during the ex-warehouse operation, acquiring information of the ex-warehouse articles through a preset virtual reality terminal device, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse articles in the virtual reality model based on the information of the ex-warehouse articles; and according to the position of the warehouse-in article or the warehouse-out article in the virtual reality model and the warehouse-out or warehouse-in path, carrying out navigation positioning on the warehouse-out or warehouse-in operation in the logistics warehouse through the preset virtual reality terminal equipment, and realizing the warehouse-out or warehouse-in operation of the article.
The Memory 6 may be, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read Only Memory (ROM), a programmable Read Only Memory (Programmable Read-Only Memory, PROM), an erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.
The processor 5 may be an integrated circuit chip with signal processing capabilities. The processor 5 may be a general-purpose processor including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
It will be appreciated that the configuration shown in fig. 6 is merely illustrative, and that the electronic device may also include more or fewer components than shown in fig. 6, or have a different configuration than shown in fig. 6. The components shown in fig. 6 may be implemented in hardware, software, or a combination thereof.
Example 4
The present invention provides a computer-readable storage medium on which a computer program is stored which, when executed by a processor 5, implements a method of geographical information data acquisition processing. For example, implementation:
collecting arrangement information of a logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information, and storing the virtual reality model at a management end; during warehousing operation, acquiring information of a warehousing object through preset virtual reality terminal equipment, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehousing path of the warehousing object in the virtual reality model based on the information of the warehousing object; during the ex-warehouse operation, acquiring information of the ex-warehouse articles through a preset virtual reality terminal device, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse articles in the virtual reality model based on the information of the ex-warehouse articles; and according to the position of the warehouse-in article or the warehouse-out article in the virtual reality model and the warehouse-out or warehouse-in path, carrying out navigation positioning on the warehouse-out or warehouse-in operation in the logistics warehouse through the preset virtual reality terminal equipment, and realizing the warehouse-out or warehouse-in operation of the article.
In the embodiments provided in the present application, it should be understood that the disclosed systems, modules, and methods may be implemented in other manners as well. The above-described system, module, and method embodiments are merely illustrative, for example, flow charts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, modules, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present application may be integrated together to form a single part, or each module may exist alone, or two or more modules may be integrated to form a single part.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (8)
1. The logistics warehouse management method based on virtual reality is characterized by comprising the following steps of:
collecting arrangement information of a logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information, and storing the virtual reality model at a management end;
during warehousing operation, acquiring information of a warehousing object through preset virtual reality terminal equipment, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehousing path of the warehousing object in the virtual reality model based on the information of the warehousing object;
during the ex-warehouse operation, acquiring information of the ex-warehouse articles through a preset virtual reality terminal device, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse articles in the virtual reality model based on the information of the ex-warehouse articles;
and according to the position of the warehouse-in article or the warehouse-out article in the virtual reality model and the warehouse-out or warehouse-in path, carrying out navigation positioning on the warehouse-out or warehouse-in operation in the logistics warehouse through the preset virtual reality terminal equipment, and realizing the warehouse-out or warehouse-in operation of the article.
2. The logistic warehouse management method based on virtual reality according to claim 1, wherein the collecting the arrangement information of the logistic warehouse comprises: acquiring image information of the logistics warehouse through a panoramic camera and fusing the image information into a two-dimensional arrangement panoramic image of the logistics warehouse; or obtaining plane and three-dimensional design drawings of the logistics warehouse.
3. The logistic warehouse management method according to claim 2, wherein the generating in advance the virtual reality model of the logistic warehouse based on the arrangement information comprises:
converting the two-dimensional arrangement panorama of the logistics warehouse into a three-dimensional virtual reality model of the logistics warehouse through an image segmentation algorithm and a depth estimation algorithm; or (b)
And constructing a three-dimensional virtual reality model of the logistics warehouse by using three-dimensional modeling software based on the acquired plane and three-dimensional design drawing of the logistics warehouse.
4. A logistic warehouse management method based on virtual reality according to claim 3, wherein the virtual reality terminal device comprises VR glasses and/or AR glasses, and the VR glasses and/or AR glasses comprise an information scanning module and a voice recognition and broadcasting module.
5. The logistic warehouse management method based on virtual reality according to claim 4, wherein the virtual reality terminal device and the management terminal are in communication connection through an internet of things or a satellite.
6. A virtual reality-based logistics warehouse management system, comprising:
the system comprises an acquisition and generation module, a management end and a storage end, wherein the acquisition and generation module is used for acquiring arrangement information of the logistics warehouse, generating a virtual reality model of the logistics warehouse in advance based on the arrangement information and storing the virtual reality model at the management end;
the first loading and determining module is used for acquiring information of the warehouse-in articles through a preset virtual reality terminal device during warehouse-in operation, loading a virtual reality model of a logistics warehouse at a management end, and determining the position and the warehouse-in path of the warehouse-in articles in the virtual reality model based on the information of the warehouse-in articles;
the second loading and determining module is used for acquiring information of the ex-warehouse objects through a preset virtual reality terminal device during ex-warehouse operation, loading a virtual reality model of a logistics warehouse at a management end, and determining the positions and the ex-warehouse paths of the ex-warehouse objects in the virtual reality model based on the information of the ex-warehouse objects;
the navigation positioning module is used for performing navigation positioning on the ex-warehouse or the in-warehouse operation in the logistics warehouse through the preset virtual reality terminal equipment according to the position of the in-warehouse article or the ex-warehouse article in the virtual reality model and the ex-warehouse or in-warehouse path, so as to realize the ex-warehouse or in-warehouse operation of the article.
7. An electronic device comprising at least one processor, at least one memory, and a data bus; wherein: the processor and the memory complete communication with each other through the data bus; the memory stores program instructions for execution by the processor, the processor invoking the program instructions to perform the method of any of claims 1-5.
8. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310114727.1A CN116070997A (en) | 2023-02-13 | 2023-02-13 | Logistics warehouse management method and system based on virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310114727.1A CN116070997A (en) | 2023-02-13 | 2023-02-13 | Logistics warehouse management method and system based on virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116070997A true CN116070997A (en) | 2023-05-05 |
Family
ID=86180004
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310114727.1A Withdrawn CN116070997A (en) | 2023-02-13 | 2023-02-13 | Logistics warehouse management method and system based on virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116070997A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116823123A (en) * | 2023-08-30 | 2023-09-29 | 青岛宇方机器人工业股份有限公司 | Warehouse management method and device based on AR positioning, electronic equipment and medium |
-
2023
- 2023-02-13 CN CN202310114727.1A patent/CN116070997A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116823123A (en) * | 2023-08-30 | 2023-09-29 | 青岛宇方机器人工业股份有限公司 | Warehouse management method and device based on AR positioning, electronic equipment and medium |
| CN116823123B (en) * | 2023-08-30 | 2023-12-05 | 青岛宇方机器人工业股份有限公司 | Warehouse management method and device based on AR positioning, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2067123B1 (en) | Method of deriving digital terrain models from digital surface models | |
| Lazaros et al. | Review of stereo vision algorithms: from software to hardware | |
| CN111902825A (en) | Polygonal object labeling system and method for training object labeling system | |
| CN111583097A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN113256778B (en) | Method, device, medium and server for generating vehicle appearance part identification sample | |
| US20120179635A1 (en) | Method and system for multiple dataset gaussian process modeling | |
| EP3465611B1 (en) | Apparatus and method for performing 3d estimation based on locally determined 3d information hypotheses | |
| Hoppe et al. | Incremental Surface Extraction from Sparse Structure-from-Motion Point Clouds. | |
| CN112651881B (en) | Image synthesizing method, apparatus, device, storage medium, and program product | |
| CN114022799A (en) | Self-supervision monocular depth estimation method and device | |
| CN112883900B (en) | Method and device for bare-ground inversion of visible images of remote sensing images | |
| Zha et al. | A real-time global stereo-matching on FPGA | |
| CN116070997A (en) | Logistics warehouse management method and system based on virtual reality | |
| Nguyen et al. | Local density encoding for robust stereo matching | |
| CN114494589A (en) | Three-dimensional reconstruction method, three-dimensional reconstruction device, electronic equipment and computer-readable storage medium | |
| Liebel et al. | A generalized multi-task learning approach to stereo DSM filtering in urban areas | |
| CN113781621A (en) | Three-dimensional reconstruction processing method, device, equipment and storage medium | |
| Buyukdemircioglu et al. | Deep learning for 3D building reconstruction: A review | |
| Meerits et al. | Real-time scene reconstruction and triangle mesh generation using multiple RGB-D cameras | |
| CN116958379A (en) | Image rendering method, device, electronic equipment, storage medium and program product | |
| CN117132737B (en) | Three-dimensional building model construction method, system and equipment | |
| Wang et al. | Instance segmentation of point cloud captured by RGB-D sensor based on deep learning | |
| CN111311732A (en) | 3D human body grid obtaining method and device | |
| US20230145498A1 (en) | Image reprojection and multi-image inpainting based on geometric depth parameters | |
| CN114549779A (en) | Scene model reconstruction method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20230505 |
|
| WW01 | Invention patent application withdrawn after publication |