CN114359521B - AR technology-based digital warehousing system and method - Google Patents
AR technology-based digital warehousing system and method Download PDFInfo
- Publication number
- CN114359521B CN114359521B CN202111577149.2A CN202111577149A CN114359521B CN 114359521 B CN114359521 B CN 114359521B CN 202111577149 A CN202111577149 A CN 202111577149A CN 114359521 B CN114359521 B CN 114359521B
- Authority
- CN
- China
- Prior art keywords
- module
- warehouse
- information
- image
- analysis processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 14
- 238000000034 method Methods 0.000 title abstract description 8
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000007405 data analysis Methods 0.000 claims abstract description 28
- 238000010276 construction Methods 0.000 claims abstract description 13
- 238000010191 image analysis Methods 0.000 claims abstract description 10
- 238000004891 communication Methods 0.000 claims abstract description 9
- 230000005540 biological transmission Effects 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000003993 interaction Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Accounting & Taxation (AREA)
- Entrepreneurship & Innovation (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a digital warehousing system and a method based on an AR technology, wherein the digital warehousing system comprises a control module, a communication interface module and a virtual enhancement module, wherein the control module is in control connection with the virtual enhancement module through the communication interface module; the invention is safe and reliable, realizes control modes of various modes by the cooperation of the gesture recognition module, the voice recognition module and the touch screen feedback module in the control module, and is convenient to use; the information in the warehouse is automatically analyzed and known through the data analysis processing module, and the possible safety accidents and temporary products are warned through the early warning module, so that the information can be conveniently and timely processed; the on-site image acquisition module, the image analysis processing module, the equipment element module, the data analysis module and the 3D image construction module in the virtual enhancement module are used for automatically acquiring warehouse information and constructing a 3D image, so that a user is on the scene, remote interaction is realized, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of AR (augmented reality), in particular to a digital warehousing system and method based on AR technology.
Background
With the vigorous development of the logistics industry nowadays, certain requirements are placed on the use of warehouse systems. However, the existing warehousing system is low in automation degree, more workers are needed to cooperate and use, safety accidents are easy to cause, and along with the development of the AR technology, the high automation of the warehousing system can be realized by combining the AR technology with the warehousing system and remotely controlling, so that the occurrence of the safety accidents is reduced.
Disclosure of Invention
In order to solve the defects in the prior art, reduce the labor cost, improve the automation degree and avoid the occurrence of safety accidents, the invention adopts the following technical scheme:
a digital warehousing system based on AR technology, comprising: the system comprises a control module, a communication interface module and a virtual enhancement module;
the virtual enhancement module comprises a field image acquisition module, an image analysis processing module, an equipment element module, a data analysis module, a 3D graphic construction module and an animation storage module; the on-site image acquisition module acquires an empty warehouse image and a full warehouse image, integrates the acquired images through the image analysis processing module, and removes a blurred image; the equipment element module acquires storage information and performs analysis processing through the data analysis module; the 3D graphic construction module acquires the integrated empty warehouse image and the empty warehouse information after analysis processing, constructs a 3D image and stores the 3D image through the animation warehouse storage module; importing the constructed 3D image, the integrated full warehouse image and the analyzed full warehouse information into a 3D image construction module to construct a real-time 3D image; transmitting the real-time 3D image and the warehouse information to a control module through the communication interface module;
the control module comprises a transmission module, a display module, a data analysis processing module, an early warning module and an instruction acquisition module; the transmission module receives the real-time 3D image and the warehouse information, and displays the real-time 3D image and the warehouse information in the warehouse through the display module; the data analysis processing module analyzes the warehouse information and alerts the situation meeting the alarming condition through the early warning module; according to the warning, an instruction acquisition module is adopted to acquire an instruction, and a transmission module is used for controlling the warehouse site to realize the purpose of remote control.
Further, the virtual enhancement module further comprises an order tracking module and a monitoring module, the order tracking module is connected with the data analysis module, the storage information further comprises logistics information, and according to the logistics information, when the warehouse needs to be taken in or taken out, the warehouse information is tracked and recorded and updated through the order tracking module, and the record is monitored through the monitoring module.
Further, the display module comprises a warehouse status display module and a warehouse information display module which are respectively used for displaying real-time 3D images and warehouse information in a warehouse.
Further, the warehouse information comprises warehouse information and product information, the warehouse information display module displays the warehouse information and the product information respectively, and the empty warehouse information and the full warehouse information are full warehouse information and empty warehouse information respectively.
Further, the early warning module comprises a safety warning module and a temporary product warning module, and when the product stacking state information and the temporary product information analyzed by the data analysis processing module reach warning conditions, the early warning module and the temporary product warning module are used for warning respectively.
Further, the instruction acquisition module comprises a gesture recognition module, a voice recognition module and a touch screen feedback module, and is used for respectively acquiring gesture, voice and touch screen feedback instructions of the terminal user and processing the warning of the warehouse site.
A digital warehousing method based on AR technology comprises the following steps:
s1, acquiring an empty warehouse image and a full warehouse image, integrating a plurality of acquired images, and removing a blurred image;
s2, acquiring storage information and analyzing and processing the storage information;
s3, constructing a 3D image through the integrated empty warehouse image and the empty warehouse information after analysis and processing;
s4, constructing a real-time 3D image by the constructed 3D image, the integrated full warehouse image and the analyzed full warehouse information;
s5, displaying the real-time 3D image and the warehouse information, analyzing the warehouse information, and warning the situation meeting the warning condition;
s6, controlling the warehouse site according to the warning, and achieving the purpose of remote control.
Further, the warehouse information also comprises logistics information, and the warehouse information is tracked, recorded and updated when the warehouse needs to be in or out of the warehouse according to the logistics information.
Further, the warehouse information comprises warehouse information and product information, and the empty warehouse information and the full warehouse information are full warehouse information and empty warehouse information respectively.
Further, the information of the alarm condition comprises product stacking state information and temporary product information, and when the information reaches the threshold value of the other side and/or the threshold value of the temporary product, the information is respectively warned.
The invention has the advantages that:
the invention is safe and reliable, realizes control modes of various modes by the cooperation of the gesture recognition module, the voice recognition module and the touch screen feedback module in the control module, and is convenient to use; the information in the warehouse is automatically analyzed and known through the data analysis processing module, and the possible safety accidents and temporary products are warned through the early warning module, so that the information can be conveniently and timely processed; the on-site image acquisition module, the image analysis processing module, the equipment element module, the data analysis module and the 3D image construction module in the virtual enhancement module are used for automatically acquiring warehouse information and constructing a 3D image, so that a user is on the scene, remote interaction is realized, and the user experience is improved.
Drawings
Fig. 1 is a schematic diagram of the system architecture of the present invention.
FIG. 2 is a schematic diagram of the system operation of the present invention.
Fig. 3 is a flow chart of the method of the present invention.
Fig. 4 is a schematic diagram of the operation of the present invention.
Detailed Description
The following describes specific embodiments of the present invention in detail with reference to the drawings. It should be understood that the detailed description and specific examples, while indicating and illustrating the invention, are not intended to limit the invention.
An embodiment of the present invention provides: as shown in fig. 1 and fig. 2, a digital warehousing system based on AR technology includes a control module 1, a communication interface module 2, and a virtual enhancement module 3, where the control module 1 is in control connection with the virtual enhancement module 3 through the communication interface module 2.
The control module 1 consists of a transmission module 11, a display module 12, a data analysis processing module 13, an early warning module 14, a gesture recognition module 15, a voice recognition module 16 and a touch screen feedback module 17; the transmission module 11 is in control connection with the data analysis processing module 13, the data analysis processing module 13 is respectively in control connection with the display module 12 and the early warning module 14, the early warning module 14 is in control connection with the display module 12, and the gesture recognition module 15, the voice recognition module 16 and the touch screen feedback module 17 are respectively in control connection with the data analysis processing module 13; the display module 12 is composed of a warehouse status display module 121 and a warehouse information display module 122, the early warning module 14 is composed of a safety warning module 141 and a temporary product warning module 142, and the warehouse status display module 121, the warehouse information display module 122, the safety warning module 141 and the temporary product warning module 142 are all in control connection with the data analysis processing module 13.
The virtual enhancement module 3 consists of a field image acquisition module 31, an image analysis processing module 32, an equipment element module 33, a data analysis module 34, a 3D graphic construction module 35, an animation library storage module 36, an order tracking module 37 and a monitoring module 38; the field image acquisition module 31 is in control connection with the image analysis processing module 32, the image analysis processing module 32 and the equipment element module 33 are in control connection with the data analysis module 34, the data analysis module 34 is in control connection with the 3D graphic construction module 35, the 3D graphic construction module 35 is in control connection with the animation storage module 36, the data analysis module 34 is in control connection with the order tracking module 37, and the order tracking module 37 is in control connection with the monitoring module 38.
As shown in fig. 3 and 4, the field image acquisition module 31 acquires the field image of the empty warehouse and the warehouse image of the full warehouse, inputs warehouse information and stored product information through the equipment element module 33, integrates a plurality of acquired images through the image analysis processing module 32, removes a blurred image, the integrated video image has 1920×1080 effective pixels, the maximum pixel number is 601 ten thousand, the optical zoom is 17 times, the effective pixel number is 400 ten thousand, the highest resolution is 1920×1080, analyzes and processes the acquired warehouse information and the stored product information through the data analysis module 34, and leads the analyzed empty warehouse information and the processed empty warehouse image into the 3D image construction module 35 to construct a 3D image, and storing the 3D image in the animation library storage module 36, then importing the 3D image, the processed full warehouse image and the stored product information into the 3D image construction module 35 to construct a real-time 3D image, then transmitting the real-time 3D image and the warehouse information to the control module 1 through the communication interface module 2, receiving the 3D image and the warehouse information by a worker through the transmission module 11 in the control module 1, displaying the 3D image in the warehouse through the warehouse status display module 121 in the display module 12, and displaying the data of the product, the warehouse data and the logistics data through the warehouse information display module 122 in the display module 12, wherein the product data table, the warehouse data table and the logistics data table are respectively as follows in tables 1, 2 and 3:
table 1:
| data item numbering | Commodity numbering |
| Alias name | Without any means for |
| Brief description of the drawings | Some kind of commodity |
| Type(s) | Character type |
| Length of | 8 bytes |
Table 2:
| data item numbering | 1-1 |
| Data item name | Inventory quantity |
| Brief description of the drawings | Quantity of various kinds of commodities |
| Type(s) | Numerical value type |
| Length of | Five-bit integer |
Table 3:
| data stream name | Warehouse entry bill |
| Brief description of the drawings | Commodity warehouse-in voucher filled by purchasing personnel |
| Data stream source | Purchasing staff |
| Data stream composition | Date |+number of warehouse entry sheets+commodity number+number of warehouse entry |
And through the constructed product data table, warehouse data table and logistics data table, establishing the association relation among the product information, warehouse information and logistics information, and providing product stacking state information and temporary product information for early warning analysis and triggering for the data analysis processing module 13.
The warehouse information is then analyzed through the data analysis processing module 13 to obtain product stacking state information and temporary product information, the safety warning module 141 and the temporary product warning module 142 are used for warning, when workers learn the safety warning or temporary product warning, instructions can be input through gestures, sounds and touch screens, the system obtains instruction information through the gesture recognition module 15, the sound recognition module 16 and the touch screen feedback module 17, the instruction information is transmitted to site workers through the transmission module 11, the site workers process the safety warning or temporary product warning through the instructions, the purpose of remote control is achieved, and when the warehouse needs to enter or leave, warehouse data are tracked and recorded through the order tracking module 37, and the monitoring module 38 is used for monitoring and recording.
The above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced with equivalents; such modifications and substitutions do not depart from the spirit of the technical solutions according to the embodiments of the present invention.
Claims (5)
1. A digital warehousing system based on AR technology, comprising: control module (1), communication interface module (2), virtual enhancement module (3), its characterized in that:
the virtual enhancement module (3) comprises a field image acquisition module (31), an image analysis processing module (32), a device element module (33), a data analysis module (34), a 3D graphic construction module (35) and an animation storage module (36); the on-site image acquisition module (31) acquires an empty warehouse image and a full warehouse image, and integrates the acquired images through the image analysis processing module (32); the equipment element module (33) acquires storage information and performs analysis processing through the data analysis module (34); the 3D graphic construction module (35) acquires the integrated empty warehouse image and the empty warehouse information after analysis processing, constructs a 3D image and stores the 3D image through the animation warehouse storage module (36); importing the constructed 3D image, the integrated full warehouse image and the analyzed full warehouse information into a 3D image construction module (35) to construct a real-time 3D image; transmitting the real-time 3D image and the warehouse information to a control module (1) through the communication interface module (2);
the control module (1) comprises a transmission module (11), a display module (12), a data analysis processing module (13), an early warning module (14) and an instruction acquisition module; the transmission module (11) receives the real-time 3D image and the warehouse information, and displays the real-time 3D image and the warehouse information in the warehouse through the display module (12); the data analysis processing module (13) analyzes the warehouse information and alerts the situation meeting the alarming condition through the early warning module (14); according to the warning, an instruction acquisition module is adopted to acquire an instruction, and a transmission module (11) is used for controlling a warehouse site;
the early warning module (14) comprises a safety warning module (141) and a temporary product warning module (142), and when the product stacking state information and the temporary product information analyzed by the data analysis processing module (13) reach warning conditions, the early warning module respectively warns through the safety warning module (141) and the temporary product warning module (142).
2. The AR technology-based digital warehousing system of claim 1, wherein: the virtual enhancement module (3) further comprises an order tracking module (37) and a monitoring module (38), the order tracking module (37) is connected with the data analysis module (34), the storage information further comprises logistics information, and according to the logistics information, the storage information is tracked and updated through the order tracking module (37), and is monitored through the monitoring module (38).
3. The AR technology-based digital warehousing system of claim 1, wherein: the display module (12) comprises a warehouse status display module (121) and a warehouse information display module (122) which are respectively used for displaying real-time 3D images and warehouse information in a warehouse.
4. A digitized warehouse system based on AR technology according to claim 3, wherein: the warehouse information comprises warehouse information and product information, and the warehouse information display module (122) displays the warehouse information and the product information respectively.
5. The AR technology-based digital warehousing system of claim 1, wherein: the instruction acquisition module comprises a gesture recognition module (15), a voice recognition module (16) and a touch screen feedback module (17), and is used for respectively acquiring gesture, voice and touch screen feedback instructions of a terminal user and processing the warning of the warehouse site.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111577149.2A CN114359521B (en) | 2021-12-22 | 2021-12-22 | AR technology-based digital warehousing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111577149.2A CN114359521B (en) | 2021-12-22 | 2021-12-22 | AR technology-based digital warehousing system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114359521A CN114359521A (en) | 2022-04-15 |
| CN114359521B true CN114359521B (en) | 2024-04-12 |
Family
ID=81100984
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111577149.2A Active CN114359521B (en) | 2021-12-22 | 2021-12-22 | AR technology-based digital warehousing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114359521B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116880477A (en) * | 2023-07-07 | 2023-10-13 | 盐城工业职业技术学院 | AGV intelligent guiding system and method applied to warehouse logistics |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203012788U (en) * | 2013-01-04 | 2013-06-19 | 电子科技大学中山学院 | Intelligent storage control system |
| CN109064100A (en) * | 2018-08-16 | 2018-12-21 | 深圳前海启航供应链管理有限公司 | Stock control monitoring system |
| CN109635132A (en) * | 2018-12-10 | 2019-04-16 | Oppo（重庆）智能科技有限公司 | A kind of Automatic Warehouse management method, system and terminal device |
| CN111444358A (en) * | 2020-03-24 | 2020-07-24 | 北京大学深圳研究生院 | Method for intelligent warehouse management |
| CN112508476A (en) * | 2020-11-20 | 2021-03-16 | 南京英诺森软件科技有限公司 | Visual management system for intelligent warehousing scene |
| CN113537880A (en) * | 2021-07-05 | 2021-10-22 | 国网山东省电力公司物资公司 | Automatic warehousing system capable of automatically establishing three-dimensional model and displaying three-dimensional model in one body |
-
2021
- 2021-12-22 CN CN202111577149.2A patent/CN114359521B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203012788U (en) * | 2013-01-04 | 2013-06-19 | 电子科技大学中山学院 | Intelligent storage control system |
| CN109064100A (en) * | 2018-08-16 | 2018-12-21 | 深圳前海启航供应链管理有限公司 | Stock control monitoring system |
| CN109635132A (en) * | 2018-12-10 | 2019-04-16 | Oppo（重庆）智能科技有限公司 | A kind of Automatic Warehouse management method, system and terminal device |
| CN111444358A (en) * | 2020-03-24 | 2020-07-24 | 北京大学深圳研究生院 | Method for intelligent warehouse management |
| CN112508476A (en) * | 2020-11-20 | 2021-03-16 | 南京英诺森软件科技有限公司 | Visual management system for intelligent warehousing scene |
| CN113537880A (en) * | 2021-07-05 | 2021-10-22 | 国网山东省电力公司物资公司 | Automatic warehousing system capable of automatically establishing three-dimensional model and displaying three-dimensional model in one body |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114359521A (en) | 2022-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3382643A1 (en) | Automated object tracking in a video feed using machine learning | |
| US8577082B2 (en) | Security device and system | |
| US9934663B2 (en) | Apparatus and method for improved live monitoring and alarm handling in video surveillance systems | |
| JP6890609B2 (en) | Information display system | |
| EP2390853A1 (en) | Time based visual review of multi-polar incidents | |
| CN114359521B (en) | AR technology-based digital warehousing system and method | |
| EP3718943A1 (en) | Real-time monitoring system, elevator or escalator comprising the same, and a method therefor | |
| CN101192328A (en) | A mapping recognition alarming system device and alarming method | |
| US20170208348A1 (en) | System and method for multiple video playback | |
| US20220222939A1 (en) | Cycle detection techniques | |
| CN114881708A (en) | Method, device, system, equipment and storage medium for monitoring delivered content | |
| EP0604009A1 (en) | Computer operation of video camera | |
| CN112129350A (en) | Chemical enterprise real scene monitoring system based on AR + security protection | |
| CN101461239B (en) | Video verification system and method for central station alarm monitoring | |
| CN113473086B (en) | Video playing method and device, electronic equipment and intelligent high-speed large screen | |
| CN114051120A (en) | Video alarm method, device, storage medium and electronic equipment | |
| EP2169490B1 (en) | Method and system for conversion of graphical representations of automation environments | |
| CN111736539B (en) | Monitoring data display method, device, system, server and storage medium | |
| CN115379178A (en) | Monitoring picture exception handling method, system, device and medium | |
| KR100794614B1 (en) | Apparatus and method for analyzing transaction data of a pos device | |
| EP3912110B1 (en) | Computer-implemented method, system and computer program for providing audit records that relate to technical equipment | |
| CN113483760A (en) | Night patrol monitoring method and device, electronic equipment and computer readable storage medium | |
| JPH06203283A (en) | History monitoring device and plant supervisory and control system | |
| JP3124414B2 (en) | Monitoring and control equipment | |
| US20240142344A1 (en) | Production line analyzer and visualizer for line performance improvement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |