CN113408992A - Material information prompting method and device, electronic equipment and storage medium - Google Patents
Material information prompting method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113408992A CN113408992A CN202110739176.9A CN202110739176A CN113408992A CN 113408992 A CN113408992 A CN 113408992A CN 202110739176 A CN202110739176 A CN 202110739176A CN 113408992 A CN113408992 A CN 113408992A
- Authority
- CN
- China
- Prior art keywords
- target
- warehouse
- information
- virtual
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000000463 material Substances 0.000 title claims abstract description 200
- 238000000034 method Methods 0.000 title claims abstract description 54
- 239000013077 target material Substances 0.000 claims abstract description 91
- 230000000007 visual effect Effects 0.000 claims abstract description 17
- 238000009877 rendering Methods 0.000 claims description 20
- 238000004364 calculation method Methods 0.000 claims description 13
- 238000012216 screening Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 238000005516 engineering process Methods 0.000 abstract description 9
- 230000003190 augmentative effect Effects 0.000 abstract description 7
- 230000010365 information processing Effects 0.000 abstract description 2
- 238000007726 management method Methods 0.000 abstract description 2
- 238000013439 planning Methods 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 239000011521 glass Substances 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000003993 interaction Effects 0.000 description 4
- 238000012384 transportation and delivery Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000004888 barrier function Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06315—Needs-based resource requirements planning or analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/067—Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Educational Administration (AREA)
- Game Theory and Decision Science (AREA)
- Finance (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Accounting & Taxation (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application provides a material information prompting method, a material information prompting device, electronic equipment and a storage medium, and relates to the technical field of augmented reality information processing, wherein the method comprises the following steps: superposing the virtual warehouse geographic model of the warehouse and the real warehouse data to obtain a target warehouse model; acquiring user coordinate data of a user terminal and target coordinate data of a target material; calculating a target path between the target coordinate data and the user coordinate data based on the target warehouse model; and generating visual virtual prompt information according to the target path so that the user terminal can display the virtual prompt information. The warehouse management system can be applied to various types of warehouses, and a plurality of material information stored in the warehouse is prompted through planning and calculating the path and the augmented reality technology so as to be supplied to warehouse workers to pick and other operations, and the efficiency and the accuracy of the picking and other operations are effectively improved.
Description
Technical Field
The application relates to the technical field of augmented reality information processing, in particular to a material information prompting method and device, electronic equipment and a storage medium.
Background
With the rapid development of electronic commerce, logistics service becomes a very critical loop, and the service quality of any link from storage and warehousing to picking and delivery and then delivery affects the final user experience. In some large-scale comprehensive warehouses, the quantity and types of stored goods are very large, and in the traditional warehouse, the goods are generally divided according to the warehouse location, the goods shelf and the like in advance, and the goods of different types are stored according to the warehouse location.
Among the prior art, select material in commodity and go out the warehouse link, face large batch and select material task, because there is the area great in traditional warehouse, the goods shelves of depositing are too much, material kind is too much, multiple reasons such as material is less, cause the screening of material, select material, the flow is numerous and diverse such as packing, delivery, total path is long, when leading to the manual work to carry out the material letter sorting, the staff need consume plenty of time and energy when familiar with topography in the warehouse, putting of goods shelves and putting rule etc. of material, thereby it is longer to cause the time of selecting material, it is lower to select material work efficiency.
Disclosure of Invention
In view of the above, an object of the embodiments of the present application is to provide a method and an apparatus for prompting material information, an electronic device, and a storage medium, so as to solve the problem of low efficiency of picking work in the prior art.
In order to solve the above problem, in a first aspect, the present application provides a material information prompting method, including:
superposing the virtual warehouse geographic model of the warehouse and the real warehouse data to obtain a target warehouse model;
acquiring user coordinate data of a user terminal and target coordinate data of a target material based on the target warehouse model;
calculating a target path between the user coordinate data and the target coordinate data;
and generating visual virtual prompt information according to the target path so that the user terminal can display the virtual prompt information.
In the implementation process, the target warehouse model with complete information is obtained by superposing the virtual model and real warehouse data, the target path between the user coordinate data and the target coordinate data is calculated on the basis of the target warehouse model, and the corresponding virtual prompt information can be generated so that the user terminal can display the virtual prompt information to prompt the material information for the staff and guide the staff to perform operations such as material picking and the like on the materials, so that the efficiency and the accuracy of the operations such as material picking and the like are effectively improved, and the method is suitable for warehouse scenes of various different types.
Optionally, when there are a plurality of target materials, the calculating a target path between the user coordinate data and the target coordinate data includes:
calculating obstacle data in the target warehouse model;
calculating shortest path information between the target coordinate data of each target material and the user coordinate data based on the obstacle data;
and taking the shortest path in the shortest path information of the target materials as the target path.
In the implementation process, when a worker conducts a sorting operation on a plurality of target materials, the shortest path information between each target material and the user can be calculated on the basis of the barrier data by calculating the plurality of barrier data in the target warehouse model, so that the shortest target path in the plurality of pieces of shortest path information is obtained, the nearest material information of the target material is guided when the plurality of target materials exist, an optimal sorting path is planned, and the working efficiency of the worker is improved.
Optionally, the overlaying the virtual warehouse geographic model of the warehouse with the real warehouse data to obtain the target warehouse model includes:
acquiring spatial position information of a plurality of shelves in the warehouse;
acquiring a material model library of the warehouse, wherein the material model library comprises a material information model of each material in the warehouse;
importing the virtual warehouse geographic model into the real warehouse data for virtual and real superposition;
and on the basis of the virtual-real superposition, superposing each material information model with the corresponding spatial position information to obtain the target warehouse model.
In the implementation process, the warehouse and the geographic model are superposed through virtual superposition of the virtual warehouse geographic model and the real warehouse data, the virtual material information model and the spatial position information in the warehouse can be correspondingly superposed on the basis of the virtual-real superposition to obtain the target warehouse model with highly superposed geographic information and position information, and the accuracy of the data in the target warehouse model can be improved to improve the accuracy of path information calculation.
Optionally, the virtual prompting message includes: virtual navigation routes and material prompt information; the generating of the visual virtual prompt information according to the target path includes:
rendering the target path to obtain rendering data;
generating the virtual navigation route according to the rendering data;
acquiring target material information of the target material;
and generating the material prompt information according to the target material information.
In the implementation process, the generated virtual prompt information comprises the virtual navigation route and the two kinds of prompt information of the material prompt information, and through the two kinds of visual virtual prompt information, the storage position, the storage path and other material information of the material in the warehouse can be prompted, the work of picking and the like is effectively prompted, and the efficiency and the accuracy of the work of picking and the like are improved.
Optionally, the method further comprises:
acquiring a material information base of the warehouse, wherein the material information base comprises material information of each material stored in the warehouse;
and screening in the material information base according to the obtained material picking requirements of the user terminal to determine a target list, wherein the target list comprises one or more target materials.
In the implementation process, before the staff picks materials, one or more target lists formed by the target materials are determined according to the obtained material information base and the picking requirements of the user terminal, so that the information of the target materials to be picked can be quickly determined in all the materials in the warehouse, the screening time is saved, and the screening efficiency is improved.
Optionally, the method further comprises:
recording the state information of the target material when the target material is sorted based on the virtual prompt information;
and updating the material information base according to the state information, or updating the target list according to the state information.
In the implementation process, the status information of the target material can be updated by recording the picking process of the target material, so that the data of the material information base of the warehouse is updated, or the target list of the user terminal is updated, and the data can be updated in real time, so that the real-time performance and accuracy of the material information base and the target list data are ensured.
Optionally, before the overlaying the virtual warehouse geographic model of the warehouse with the real warehouse data to obtain the target warehouse model, the method further includes:
acquiring three-dimensional data of the warehouse;
and establishing the virtual warehouse geographic model according to the three-dimensional data.
In the implementation process, the obtained three-dimensional data of the real warehouse can be used for establishing the virtual warehouse geographic model for obtaining the three-dimensional object corresponding to the warehouse, so that the virtual warehouse geographic model and the real warehouse data are superposed, and the accuracy of virtual-real superposition is effectively improved.
In a second aspect, an embodiment of the present application further provides a material information prompting device, where the device includes:
the superposition module is used for superposing the virtual warehouse geographic model of the warehouse and the real warehouse data to obtain a target warehouse model;
the acquisition module is used for acquiring user coordinate data of the user terminal and target coordinate data of the target material based on the target warehouse model;
the calculation module is used for calculating a target path between the target coordinate data and the user coordinate data;
and the generating module is used for generating visual virtual prompt information according to the target path so that the user terminal can display the virtual prompt information.
In the implementation process, the target warehouse model after virtual-real superposition is obtained through the superposition module, the target path between the user and the geographic position of the target material is calculated on the basis of the target warehouse model, the corresponding virtual prompt information is generated so that the user terminal can display the virtual prompt information, the prompt of material information can be carried out on the staff, the staff is guided to carry out operations such as material picking and the like, the efficiency and the accuracy of the operations such as material picking and the like are effectively improved, and the method is suitable for warehouse scenes of various different types.
In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, where the memory stores program instructions, and the processor executes the steps in any implementation manner of the first aspect when reading and executing the program instructions.
In a fourth aspect, an embodiment of the present application further provides a readable storage medium, where computer program instructions are stored, and when the computer program instructions are read and executed by a processor, the steps in any implementation manner of the first aspect are executed.
To sum up, the embodiment of the application provides a material information prompting method, a device, an electronic device and a storage medium, which are applicable to various types of warehouses, can prompt a plurality of material information stored in the warehouse through an augmented reality technology and path calculation so as to guide and prompt workers, realize operations such as quick material picking and the like, and effectively improve the efficiency and accuracy of the operations such as material picking and the like.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic diagram illustrating interaction between a server and a user terminal according to an embodiment of the present application;
fig. 2 is a schematic flow chart of a material information prompting method according to an embodiment of the present application;
fig. 3 is a detailed flowchart of step S3 according to an embodiment of the present disclosure;
fig. 4 is a detailed flowchart of step S1 according to an embodiment of the present disclosure;
fig. 5 is a detailed flowchart of step S4 according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a material information prompting device according to an embodiment of the present application.
Icon: a server-100; a user terminal-200; material information prompting device-300; an overlap-and-add module-310; an acquisition module-320; a calculation module-330; module-340 is generated.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without any creative effort belong to the protection scope of the embodiments of the present application.
The embodiment of the application provides a material information prompting method, which is applied to a server, wherein the server can be an electronic device with a logic computing function, such as a Personal Computer (PC), a tablet Personal Computer, a smart phone, a Personal Digital Assistant (PDA), AR (Augmented Reality) glasses, MR (Mixed Reality) glasses and the like. The material information prompting method provided by the embodiment of the application can prompt a plurality of material information stored in the warehouse so as to improve the efficiency and accuracy of operations such as material picking of workers.
Referring to fig. 1, fig. 1 is a schematic diagram of interaction between a server and a user terminal according to an embodiment of the present application, where the schematic diagram includes the following interaction devices: a server 100 and a user terminal 200. The server 100 is communicatively connected to one or more (only one shown) user terminals 200 through a wired network or a wireless network for data communication or interaction.
The server 100 may be disposed on an electronic device with a logic calculation function, such as a personal computer, a tablet computer, a smart phone, and a personal digital assistant, and is configured to obtain user coordinate data of the user terminal 200 and target coordinate data of a target material in a warehouse where the user terminal is located, calculate a target path according to an established target warehouse model, and send visual virtual prompt information generated according to the target path to the user terminal 200.
The user terminal 200, which may be an electronic device employing an AR technology or an MR technology, such as AR glasses, MR glasses, and the like, is configured to send user coordinate data of itself to the server 100, receive visual virtual prompt information generated by the server 100 after calculation, and display the virtual prompt information, so that a user for use can view the virtual prompt information, thereby prompting material information in a warehouse.
It should be noted that the AR technology is a further development of the VR (Virtual Reality) technology, and presents Virtual scene information in a real scene to build an interactive feedback information loop among the real world, the Virtual world and a user, so as to enhance the Reality of the user experience. The MR technology is further developed by VR technology, and by introducing real scene information into a virtual environment, an interactive feedback information loop is built among a virtual world, the real world and a user so as to enhance the sense of reality of user experience. At traditional warehouse material sorting, the task is heavy, under the condition of inefficiency, with augmented reality or mixed reality as technical basis, with the virtual route of looking for something as supplementary, in order to reach effectual visual guide, the guide user accomplishes the flow operation, and can realize the liberation of both hands at the in-process of operation, can accomplish the task fast, high-efficient, directly.
Referring to fig. 2, fig. 2 is a schematic flow chart of a material information prompting method according to an embodiment of the present application, including the following steps.
And step S1, superposing the virtual warehouse geographic model of the warehouse with the real warehouse data to obtain a target warehouse model.
Optionally, before step S1, the method further comprises: acquiring three-dimensional data of the warehouse; and establishing the virtual warehouse geographic model according to the three-dimensional data.
It is worth to be noted that before the virtual-real superposition, the real environment of the warehouse can be three-dimensionally modeled, and the three-dimensional data of the warehouse can be obtained by obtaining the three-dimensional building data of the measured warehouse or by searching the historical building data of the warehouse. Illustratively, the three-dimensional data may include area data, structural data, frame data, and the like of a warehouse. And correspondingly modeling the real warehouse environment according to the acquired three-dimensional data so as to realize the superposition of the virtual warehouse geographic model and the real warehouse data, thereby effectively increasing the accuracy of virtual-real superposition.
And step S2, acquiring the user coordinate data of the user terminal and the target coordinate data of the target material based on the target warehouse model.
The user terminal has a positioning function, and on the basis of the target warehouse model after the virtual-real superposition, user target data after the user terminal positions the user terminal and target coordinate data of the determined target material are obtained.
It is to be noted that, when acquiring the user coordinate data of the user terminal, three-dimensional model data of the user, for example, cylinder data having a height of 1.6 m and a radius of 0.5 m, may be set in devices such as AR glasses, MR glasses, and the like. The users for sorting can be the staff of the warehouse, and also can be the robots and the like for sorting, and the user coordinate data of different users can be obtained according to the three-dimensional model data of different users, so that the accuracy of the user coordinate can be effectively improved. When the target coordinate data of the target material is acquired, in the target warehouse model after virtual-real superposition, the coordinates are acquired according to the real position of the real environment where the target material is located, so that the acquisition time of the position information can be shortened, the position of the material can be changed frequently, and the position information can be acquired quickly when a user needs to be familiar with the position of the material again.
Optionally, before step S2, the method further comprises the following steps.
And step Sa1, acquiring a material information base of the warehouse.
The material information base comprises material information of each material stored in the warehouse.
It should be noted that after the warehouse stores the materials, the label information of each material may be obtained, the label information may be identification data such as a bar code and a two-dimensional code, and the material information included in the label information may be obtained by identifying the label information in an identification manner such as scanning. Illustratively, the material information may include: name information of the material, such as codes, numbers and the like, position information of the material, such as shelf numbers, item numbers, material frame numbers and the like, type information, three-dimensional information, time information and the like of the material and material-related information. The server acquires the material information of the materials according to the label information, integrates all the material information in the warehouse into a material information base, and can realize real-time updating of the material information base by scanning the label information when the materials are put in and taken out of the warehouse.
Step Sa2, selecting from the material information base according to the obtained sorting requirement of the user terminal, and determining a target list, wherein the target list includes one or more target materials.
Optionally, the user terminal may determine the picking requirement of the picking job according to the selection of the user.
For example, the culling requirement may be to cull a certain type of material, for example, to cull a commodity type of material. The sorting requirement can also be the sorting of materials with certain time information, for example, the sorting of materials with warehousing time of a certain day in a certain month in a certain year. The picking requirement can also be a material with certain place information, for example, a plurality of picking requirements such as picking materials with goods receiving addresses of Beijing, and the user can correspondingly select the materials according to the working requirement and the actual working condition of the user.
The server obtains the sorting requirements determined in the user terminal, and screens out a target list meeting the sorting requirements according to the sorting requirements. The target list comprises material information of one or more materials which meet the sorting requirement and need to be sorted, the one or more target materials meeting the sorting requirement are obtained, the information of the target materials which need to be sorted can be rapidly determined in all materials in the warehouse, the screening time is saved, and the screening efficiency is improved.
After the execution of step S2, the execution of step S3 is continued.
Step S3, a target path between the user coordinate data and the target coordinate data is calculated.
After the user coordinate data of the user terminal and the target coordinate data of the target material are obtained, a point where the user coordinate data is located is used as a starting coordinate, a point where the target coordinate data is located is used as an end coordinate, and a barrier-free target path with the shortest distance is calculated.
After the execution of step S3, the execution of step S4 is continued.
Step S4, generating visual virtual prompt information according to the target path, so that the user terminal displays the virtual prompt information.
And processing the obtained target path to generate visual virtual prompt information for prompting. Illustratively, the virtual reminder information may be a variety of display information displayed in the user terminal such as AR glasses.
After the server generates the virtual prompt information, the server can send the virtual prompt information to the user terminal through a wired or wireless network, and the user terminal can select to modify, store, report errors and other related operations on the virtual prompt information after receiving and checking the virtual prompt information.
Optionally, after step S4, the method further comprises the following steps.
And step Sb1, recording the state information of the target material when the target material is sorted based on the virtual prompt information.
Alternatively, the status information of the items may include picking time information when the items are picked, such as time information from the prompt to the completion of the picking, and the like. Because the time difference when different materials are picked is great, there is not comparatively accurate time in order to arrange the scheduling plan, therefore there is the difference in the work load that different staff worked. Through the record to the time of picking, can be through the long time of picking of record every article material, calculate the average value and be used for the user to know the time of picking of every article material, realize the reasonable arrangement to picking, obtain reasonable scheduling plan.
Optionally, the status information of the items may also include current information of the target item, such as current real-time information of various items that have been picked, are about to be ex-warehouse, are about to be transferred, and so on.
And step Sb2, updating the material information base according to the state information, or updating the target list according to the state information. For example, the sorted materials can be subjected to various operations such as ex-warehouse and transfer, the user terminal can scan the label information of the materials, perform ex-warehouse and transfer processing and recording, and the server receives relevant data of ex-warehouse.
It should be noted that, the server updates the material information base or the target list according to the state information of the target material, for example, when the state information of the target material is the delivery status, the material information of the target material is transferred to the delivered material information base in the material information base, or the target material is removed from the target list, the picked list is added, and the like, so that the data can be updated in real time, and the real-time performance and accuracy of the data of the material information base and the target list are ensured.
In the embodiment shown in fig. 2, by calculating the path information, the corresponding virtual prompt information can be generated, so that the user terminal can display the virtual prompt information to prompt the staff for the material information, and guide the staff to perform operations such as sorting on the material, thereby effectively improving the efficiency and accuracy of the operations such as sorting, and being suitable for various different types of warehouse scenes.
Referring to FIG. 3, the step S3 in the present embodiment may include steps S31-S33.
Step S31, obstacle data in the target warehouse model is calculated.
It is worth noting that due to the presence of one or more different sizes, types, levels of shelves and other obstructions in the warehouse, these obstructions become obstacles in the path as the path is planned. When obstacle data is calculated, coordinates of an obstacle can be determined according to a target warehouse model, for example, textures of the obstacle are obtained from the target warehouse model, vertex coordinates composed of triangular surfaces are contained in the textures, each vertex coordinate contains three-dimensional coordinate data, the obstacle can be set to be a height larger than 0.1 meter and a height smaller than 0.1 meter, the obstacle data of a plurality of obstacles in the warehouse can be calculated.
Step S32, based on the obstacle data, calculating shortest path information between the target coordinate data of each target material and the user coordinate data.
When a plurality of target materials exist, the target coordinate data of each target material can be acquired simultaneously, and on the basis of the calculated obstacle data, the user coordinate data and each target coordinate data are simultaneously integrated to calculate the path information, so that the shortest path information between each target material and the position of the user terminal is obtained and serves as the shortest path information.
And step S33, taking the shortest path in the shortest path information of the target materials as the target path.
And comparing the calculated multiple pieces of shortest path information, and taking the shortest path information with the shortest path as a target path. And taking the target material corresponding to the target path as an object which needs to be sorted by a user.
It should be noted that when the picking task is complex, the user does not know which material to pick from, and the user relies on experience to determine, when there are multiple target materials to be picked, after determining the shortest target path and the corresponding target material, the user can continue to obtain the user coordinate data and the target coordinate data of each target material at the current location of the user terminal after picking the target material, and then calculate and compare the path information to obtain the shortest target path and the corresponding target material. Repeating above-mentioned step, all being sorted until a plurality of target materials and finishing, can carrying out reasonable planning and sequencing to a plurality of tasks of choosing materials, reducing the time of turning back, be applicable to new staff or the staff unfamiliar with to the warehouse environment, make the staff familiar with warehouse environment and material position fast, guide the staff and independently accomplish the task according to the flow, need not the experience, reduce master-slave training time of taking a management, increase the efficiency of hands.
In the embodiment shown in fig. 3, when a worker sorts a plurality of target materials, the shortest path information in the plurality of target materials can be calculated, so that when a plurality of target materials exist, the nearest material information of the target materials is guided, an optimal sorting path is planned, and the working efficiency of the worker is improved.
Referring to FIG. 4, the step S1 in the present embodiment may include steps S11-S14.
Step S11, spatial location information of a plurality of shelves in the warehouse is acquired.
The obtained space position information of the shelf may include information of a material frame set on the shelf, coordinate information of the shelf, space information of the shelf, structural hierarchy information of the shelf, and type information of the shelf, such as height, width, number of layers information, and number of lattices of the material frame of the shelf, which are related to the shelf.
And step S12, acquiring a material model library of the warehouse.
The material information model of each material in the warehouse is stored in the material model library, and the material information model can include volume information of the material, three-dimensional information of the material, type information of the material, material frame information corresponding to the material information model and other information related to the material.
It is worth mentioning that after the materials are put in a warehouse, the material model can be established according to the label information of the materials. The label information comprises related information of the material, and also can comprise identification data corresponding to the material, such as a bar code, a two-dimensional code and the like, and the label information of the material can be acquired by identifying the data, so that the establishment of a material information model is realized.
And step S13, importing the virtual warehouse geographic model into the real warehouse data for virtual and real superposition.
It should be noted that, when performing virtual-real superposition, any point in the real warehouse may be selected as an origin of coordinates, set as an anchor point, a point at the same position in the virtual warehouse geographic model is set as an origin, and the virtual warehouse geographic model is imported into the real warehouse geographic model of the real warehouse data, so that the two origins are superposed and superposed. For example, in the selection of the anchor point, the azimuth vertex of the warehouse may be selected as the anchor point to increase the accuracy of the virtual-real superposition.
And step S14, on the basis of the virtual-real superposition, superposing each material information model with the corresponding spatial position information to obtain the target warehouse model.
After the geographic models are overlapped, each material information model and the corresponding shelf space position information are in one-to-one correspondence according to the placement condition of the materials on the shelves in the real warehouse data, each material information model is correspondingly placed in the correct material frame position on the corresponding shelf, and the effects of corresponding the material information models to the placement positions and overlapping virtual material simulation are achieved. The obtained material information model in the target warehouse model can coincide with the real placement condition of the materials in the warehouse, so that the accuracy of the material position is improved.
In the embodiment shown in fig. 4, virtual-real superposition is performed to correspondingly coincide the virtual material information model with the spatial location information in the warehouse, so as to obtain a target warehouse model with highly coincident geographic information and location information, which can improve the accuracy of data in the target warehouse model and improve the accuracy of path information calculation.
Referring to FIG. 5, the step S4 in the present embodiment may include steps S41-S44.
And step S41, rendering the target path to obtain rendering data.
The texture vertex coordinates are set according to the start point coordinates and the end point coordinates in the target path, and a rendering picture is input for rendering, for example, the rendering picture may be a picture of some obstacles in the target path, a related picture of the start point and the end point, and the like.
And step S42, generating the virtual navigation route according to the rendering data.
According to rendering data obtained by rendering, when a path contains a barrier, setting a path coordinate point 1 of an intersection, and so on, setting texture vertex coordinates according to a starting coordinate, middle path coordinates 1 to n and a terminal coordinate, and rendering to generate a visual virtual navigation route.
It should be noted that the virtual navigation route may include visual direction indication information, such as directional arrows, text descriptions, etc.; the distance information of the route, for example, the length of the straight line is ten meters, the length of the right line is five meters, and the like, may also be included, and the route display data, for example, the navigation information that the route that has not passed through is a green route, and the route that has passed through is a red route, and the like is visualized may also be included.
And step S43, acquiring target material information of the target material.
The method comprises the steps of obtaining target material information of a target material needing to be sorted corresponding to a target path, wherein the target material information can comprise shelf information of the target material, type information of the material, information of a material frame of the material and the like.
It should be noted that, after the target path and the corresponding target material are determined, the server may further send the tag information of the target material to the user terminal, so that the user terminal can correspondingly obtain the information of the target material.
And step S44, generating the material prompt information according to the target material information.
It is worth mentioning that the target materials need to be prompted under the conditions of larger shelves or smaller materials and the like so as to assist the user in picking the target materials on the basis of the virtual navigation route, and the time consumed by the user to find the target materials at the end point due to the larger shelves or the smaller materials is reduced. The material prompt information can be generated at the end point of the target path, namely around the target material, according to the target material information, the material prompt information comprises information such as shelf position information and state information of the target material, so that a user can check the material prompt information, the position of the target material on a shelf is quickly determined, the search time is shortened, information verification can be performed on the target material, and the occurrence of material sorting errors is reduced.
Illustratively, the target material information includes calculated volume information of the material, and the user can be prompted to select a proper envelope to package the material after sorting according to the volume information.
In the embodiment shown in fig. 5, two visual virtual prompt messages can prompt material information such as the storage position, the access path and the like of the material in the warehouse, effectively prompt work such as material picking and the like, and improve the efficiency and the accuracy of the work such as material picking and the like.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a material information prompting device according to an embodiment of the present application, where the material information prompting device 300 includes: an overlay module 310, an acquisition module 320, a calculation module 330, and a generation module 340.
The superposition module 310 is configured to superpose the virtual warehouse geographic model of the warehouse with the real warehouse data to obtain a target warehouse model;
an obtaining module 320, configured to obtain, based on the target warehouse model, user coordinate data of a user terminal and target coordinate data of a target material;
a calculating module 330, configured to calculate a target path between the target coordinate data and the user coordinate data;
the generating module 340 is configured to generate visual virtual prompt information according to the target path, so that the user terminal displays the virtual prompt information.
The calculation module 330 further includes: the obstacle submodule, the calculation submodule and the comparison submodule are connected;
an obstacle submodule for calculating obstacle data in the target warehouse model;
the calculation submodule is used for calculating shortest path information between the target coordinate data of each target material and the user coordinate data based on the obstacle data;
and the comparison submodule is used for taking the shortest path in the shortest path information of the target materials as the target path.
The overlay module 310 further includes: a space acquisition submodule, a model acquisition submodule and a superposition submodule;
the space acquisition submodule is used for acquiring space position information of a plurality of shelves in the warehouse;
the model acquisition submodule is used for acquiring a material model library of the warehouse, wherein the material model library comprises a material information model of each material in the warehouse;
the superposition submodule is used for importing the virtual warehouse geographic model into the real warehouse data for virtual and real superposition;
and on the basis of the virtual-real superposition, superposing each material information model with the corresponding spatial position information to obtain the target warehouse model.
The generating module 340 further includes: a rendering submodule and a prompting submodule;
the rendering submodule is used for rendering the target path to obtain rendering data;
generating the virtual navigation route according to the rendering data;
the prompting submodule is used for acquiring target material information of the target material;
and generating the material prompt information according to the target material information.
The material information presentation device 300 further includes: the system comprises a screening module, an updating module and a modeling module;
the screening module is used for acquiring a material information base of the warehouse, wherein the material information base comprises material information of each material stored in the warehouse;
and screening in the material information base according to the obtained material picking requirements of the user terminal to determine a target list, wherein the target list comprises one or more target materials.
The updating module is used for recording the state information of the target material when the target material is sorted based on the virtual prompt information;
and updating the material information base according to the state information, or updating the target list according to the state information.
The modeling module is used for acquiring three-dimensional data of the warehouse;
and establishing the virtual warehouse geographic model according to the three-dimensional data.
Because the principle of the device in the embodiment of the present application for solving the problem is similar to that in the embodiment of the material information prompting method, the implementation of the device in the embodiment of the present application may refer to the description in the embodiment of the method, and repeated details are not repeated.
In the embodiment shown in fig. 6, the plurality of modules prompt the staff for material information to guide the staff to perform operations such as material picking on the materials, so that the efficiency and accuracy of the operations such as material picking are effectively improved, and the system is suitable for warehouse scenes of various different types.
The embodiment of the application further provides electronic equipment, which comprises a memory and a processor, wherein program instructions are stored in the memory, and when the processor reads and runs the program instructions, the steps in any one of the method for prompting the material information provided by the embodiment are executed.
It should be understood that the electronic device may be a personal computer, a tablet computer, a smartphone, a personal digital assistant, AR glasses, MR glasses, or other electronic device having logical computing functionality.
The embodiment of the application also provides a readable storage medium, wherein computer program instructions are stored in the readable storage medium, and the computer program instructions are read by a processor and executed when the computer program instructions are executed, so that the steps in the material information prompting method are executed.
To sum up, the embodiment of the application provides a material information prompting method, a device, an electronic device and a storage medium, which are applicable to various types of warehouses, can prompt a plurality of material information stored in the warehouse through an augmented reality technology and path calculation so as to guide and prompt workers, realize operations such as quick material picking and the like, and effectively improve the efficiency and accuracy of the operations such as material picking and the like.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. The apparatus embodiments described above are merely illustrative, and for example, the block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices according to various embodiments of the present application. In this regard, each block in the block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams, and combinations of blocks in the block diagrams, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Therefore, the present embodiment further provides a readable storage medium, in which computer program instructions are stored, and when the computer program instructions are read and executed by a processor, the computer program instructions perform the steps of any of the block data storage methods. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a RanDom Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A material information prompting method is characterized by comprising the following steps:
superposing the virtual warehouse geographic model of the warehouse and the real warehouse data to obtain a target warehouse model;
acquiring user coordinate data of a user terminal and target coordinate data of a target material based on the target warehouse model;
calculating a target path between the user coordinate data and the target coordinate data;
and generating visual virtual prompt information according to the target path so that the user terminal can display the virtual prompt information.
2. The method of claim 1, wherein said calculating a target path between said user coordinate data and said target coordinate data when there are a plurality of said target materials comprises:
calculating obstacle data in the target warehouse model;
calculating shortest path information between the target coordinate data of each target material and the user coordinate data based on the obstacle data;
and taking the shortest path in the shortest path information of the target materials as the target path.
3. The method of claim 1, wherein overlaying the virtual warehouse geographic model of the warehouse with the real warehouse data to obtain a target warehouse model comprises:
acquiring spatial position information of a plurality of shelves in the warehouse;
acquiring a material model library of the warehouse, wherein the material model library comprises a material information model of each material in the warehouse;
importing the virtual warehouse geographic model into the real warehouse data for virtual and real superposition;
and on the basis of the virtual-real superposition, superposing each material information model with the corresponding spatial position information to obtain the target warehouse model.
4. The method of claim 1, wherein the virtual hint information comprises: virtual navigation routes and material prompt information; the generating of the visual virtual prompt information according to the target path includes:
rendering the target path to obtain rendering data;
generating the virtual navigation route according to the rendering data;
acquiring target material information of the target material;
and generating the material prompt information according to the target material information.
5. The method of claim 1, further comprising:
acquiring a material information base of the warehouse, wherein the material information base comprises material information of each material stored in the warehouse;
and screening in the material information base according to the obtained material picking requirements of the user terminal to determine a target list, wherein the target list comprises one or more target materials.
6. The method of claim 5, further comprising:
recording the state information of the target material when the target material is sorted based on the virtual prompt information;
and updating the material information base according to the state information, or updating the target list according to the state information.
7. The method of claim 1, wherein prior to superimposing the virtual warehouse geographic model of the warehouse with the real warehouse data to obtain the target warehouse model, the method further comprises:
acquiring three-dimensional data of the warehouse;
and establishing the virtual warehouse geographic model according to the three-dimensional data.
8. A material information prompting device, characterized in that the device comprises:
the superposition module is used for superposing the virtual warehouse geographic model of the warehouse and the real warehouse data to obtain a target warehouse model;
the acquisition module is used for acquiring user coordinate data of the user terminal and target coordinate data of the target material based on the target warehouse model;
the calculation module is used for calculating a target path between the target coordinate data and the user coordinate data;
and the generating module is used for generating visual virtual prompt information according to the target path so that the user terminal can display the virtual prompt information.
9. An electronic device comprising a memory having stored therein program instructions and a processor that, when executed, performs the steps of the method of any of claims 1-7.
10. A readable storage medium having stored thereon computer program instructions for executing the steps of the method according to any one of claims 1 to 7 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110739176.9A CN113408992A (en) | 2021-06-30 | 2021-06-30 | Material information prompting method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110739176.9A CN113408992A (en) | 2021-06-30 | 2021-06-30 | Material information prompting method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113408992A true CN113408992A (en) | 2021-09-17 |
Family
ID=77680539
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110739176.9A Pending CN113408992A (en) | 2021-06-30 | 2021-06-30 | Material information prompting method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113408992A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113895846A (en) * | 2021-10-29 | 2022-01-07 | 广东利元亨智能装备股份有限公司 | Storage policy management method and device, electronic equipment and storage medium |
| CN115829175A (en) * | 2022-11-10 | 2023-03-21 | 太原福莱瑞达物流设备科技有限公司 | Goods storage operation route selection method, device, system and medium for dense warehouse |
| CN116823123A (en) * | 2023-08-30 | 2023-09-29 | 青岛宇方机器人工业股份有限公司 | Warehouse management method and device based on AR positioning, electronic equipment and medium |
| CN117436675A (en) * | 2023-12-20 | 2024-01-23 | 国网浙江省电力有限公司金华供电公司 | Method and system for generating intelligent personal and vehicular access strategy for green warehouse park |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096865A (en) * | 2011-02-01 | 2011-06-15 | 武汉理工大学 | Dynamic management method and system for mobile rack automatic warehouse |
| CN205518664U (en) * | 2016-03-16 | 2016-08-31 | 宣邦智能科技（上海）有限公司 | Intelligence warehouse system of selecting based on pronunciation |
| CN106557906A (en) * | 2016-11-30 | 2017-04-05 | 长威信息科技发展股份有限公司 | A kind of warehouse management method and system based on three-dimensional modeling |
| CN107944781A (en) * | 2016-10-12 | 2018-04-20 | 菜鸟智能物流控股有限公司 | Method and device for providing prompt information of stored object |
| US20190240834A1 (en) * | 2016-10-13 | 2019-08-08 | Beijing Jingdong Shangke Information Technology Co, Ltd. | Dispatching method and device, and non-transitory readable storage medium |
| JP2020187620A (en) * | 2019-05-16 | 2020-11-19 | Ｎｅｃフィールディング株式会社 | Physical distribution management system, physical distribution management method, and program |
-
2021
- 2021-06-30 CN CN202110739176.9A patent/CN113408992A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096865A (en) * | 2011-02-01 | 2011-06-15 | 武汉理工大学 | Dynamic management method and system for mobile rack automatic warehouse |
| CN205518664U (en) * | 2016-03-16 | 2016-08-31 | 宣邦智能科技（上海）有限公司 | Intelligence warehouse system of selecting based on pronunciation |
| CN107944781A (en) * | 2016-10-12 | 2018-04-20 | 菜鸟智能物流控股有限公司 | Method and device for providing prompt information of stored object |
| US20190240834A1 (en) * | 2016-10-13 | 2019-08-08 | Beijing Jingdong Shangke Information Technology Co, Ltd. | Dispatching method and device, and non-transitory readable storage medium |
| CN106557906A (en) * | 2016-11-30 | 2017-04-05 | 长威信息科技发展股份有限公司 | A kind of warehouse management method and system based on three-dimensional modeling |
| JP2020187620A (en) * | 2019-05-16 | 2020-11-19 | Ｎｅｃフィールディング株式会社 | Physical distribution management system, physical distribution management method, and program |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113895846A (en) * | 2021-10-29 | 2022-01-07 | 广东利元亨智能装备股份有限公司 | Storage policy management method and device, electronic equipment and storage medium |
| CN113895846B (en) * | 2021-10-29 | 2022-11-18 | 广东利元亨智能装备股份有限公司 | Storage policy management method and device, electronic equipment and storage medium |
| CN115829175A (en) * | 2022-11-10 | 2023-03-21 | 太原福莱瑞达物流设备科技有限公司 | Goods storage operation route selection method, device, system and medium for dense warehouse |
| CN115829175B (en) * | 2022-11-10 | 2023-11-24 | 太原福莱瑞达物流设备科技有限公司 | Goods storage operation route selection method, device, system and medium for dense warehouse |
| CN116823123A (en) * | 2023-08-30 | 2023-09-29 | 青岛宇方机器人工业股份有限公司 | Warehouse management method and device based on AR positioning, electronic equipment and medium |
| CN116823123B (en) * | 2023-08-30 | 2023-12-05 | 青岛宇方机器人工业股份有限公司 | Warehouse management method and device based on AR positioning, electronic equipment and medium |
| CN117436675A (en) * | 2023-12-20 | 2024-01-23 | 国网浙江省电力有限公司金华供电公司 | Method and system for generating intelligent personal and vehicular access strategy for green warehouse park |
| CN117436675B (en) * | 2023-12-20 | 2024-03-08 | 国网浙江省电力有限公司金华供电公司 | Method and system for generating intelligent personal and vehicular access strategy for green warehouse park |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113408992A (en) | Material information prompting method and device, electronic equipment and storage medium | |
| US11288412B2 (en) | Computation of point clouds and joint display of point clouds and building information models with project schedules for monitoring construction progress, productivity, and risk for delays | |
| Cirulis et al. | Augmented reality in logistics | |
| Sacks et al. | Visualization of work flow to support lean construction | |
| EP2755096A1 (en) | Work management system, work management terminal, program and work management method | |
| US9886678B2 (en) | Graphic representations of planograms | |
| Hirsch | An algorithm for automatic name placement around point data | |
| Ikonen et al. | Use of embedded RFID tags in concrete element supply chains. | |
| EP1139251A2 (en) | Value chain optimization system and method | |
| CN114067048A (en) | Material transfer visual intelligent system and construction method | |
| JP4851796B2 (en) | Traceability information collection method, traceability information collection system, and purchased parts information input terminal | |
| KR101282215B1 (en) | System and method for quantity surveying | |
| Suk et al. | A study on the effect of the use of augmented reality on students' quantity take-off performance | |
| US20220277268A1 (en) | Project management apparatus, project management method, and recording medium | |
| KR20110109710A (en) | Three dimensional system and method for monitoring process | |
| CN101300564A (en) | Spreadsheet user-interface for an enterprise planning system having multi-dimensinal data store | |
| Luyster et al. | Creating your lean future state | |
| Zhu et al. | Vision-based precast concrete management plan in off-site construction site: Using PC member quality grades | |
| CN117473592B (en) | Data display method and device based on industrial large model | |
| Murray et al. | A virtual environment for building construction | |
| JP5554674B2 (en) | Breakeven point simulation system, method, and program | |
| Dao | Modelling and intelligent optimisation of production scheduling in VCIM systems | |
| Nguyen et al. | A Risk Management Tool for the Reverse Supply Chain Network | |
| CN109685219A (en) | The O&M repairing operational method and platform of power grid user equipment | |
| Shi | Framework for integration of BIM and RFID in steel construction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210917 |