CN117061700A - Warehouse article monitoring method and device, electronic equipment and storage medium - Google Patents
Warehouse article monitoring method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117061700A CN117061700A CN202310816012.0A CN202310816012A CN117061700A CN 117061700 A CN117061700 A CN 117061700A CN 202310816012 A CN202310816012 A CN 202310816012A CN 117061700 A CN117061700 A CN 117061700A
- Authority
- CN
- China
- Prior art keywords
- information
- positioning
- mode
- article
- light sensation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 114
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000035807 sensation Effects 0.000 claims abstract description 95
- 238000004590 computer program Methods 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000005855 radiation Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
- G01D21/02—Measuring two or more variables by means not covered by a single other subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
- G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device
- G06K17/0029—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device the arrangement being specially adapted for wireless interrogation of grouped or bundled articles tagged with wireless record carriers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/254—Analysis of motion involving subtraction of images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Economics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Development Economics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Entrepreneurship & Innovation (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
Abstract
The embodiment of the invention discloses a method, a device, electronic equipment and a storage medium for monitoring storage articles, wherein the method comprises the steps of monitoring vibration information of the storage articles and light sensation information in a preset area of the storage articles; acquiring a monitoring video of the warehouse article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition; acquiring positioning information of the storage articles in a preset positioning mode; and generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information. According to the technical scheme, the monitoring of the stored articles is realized, and the early warning information of the stored articles can be generated according to the vibration information, the light sensation information, the monitoring video and the positioning information under the condition that the vibration information and the light sensation information meet the conditions, so that the timeliness and the accuracy of early warning are improved, and the safety of the stored articles is ensured.
Description
Technical Field
The present invention relates to the field of monitoring technologies, and in particular, to a method and apparatus for monitoring a warehouse article, an electronic device, and a storage medium.
Background
Many companies and factories today have their own warehouse stores for storing items. Many articles are more valuable, and the monitoring facility can help the caretaker to manage the articles, but the caretaker needs to check the monitoring video at any time, or the monitoring video can be patrolled in the warehouse, if the warehouse is more, the warehouse is bigger, the workload of the staff is increased, and the labor cost is also increased. And if the monitoring video is not checked by the staff in time, the possibility that the articles are stolen and cannot be recovered in time exists, so that economic loss is caused.
Therefore, a way to monitor the warehouse articles is needed to solve the above technical problems.
Disclosure of Invention
The embodiment of the invention provides a method, a device, electronic equipment and a storage medium for monitoring stored articles, which realize storage of the stored articles and improve the real-time performance of monitoring and the safety of the stored articles.
In a first aspect, an embodiment of the present invention provides a method for monitoring a warehouse article, where the method includes:
monitoring vibration information of the stored articles and light sensation information in a preset area comprising the stored articles;
Acquiring a monitoring video of the warehouse article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition;
acquiring positioning information of the storage articles in a preset positioning mode;
and generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
In a second aspect, an embodiment of the present invention further provides a device for monitoring a warehouse article, where the device includes:
the information acquisition module is used for monitoring vibration information of the storage articles and comprises light sensation information in a preset area of the storage articles;
the monitoring video acquisition module is used for acquiring the monitoring video of the storage article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition;
the positioning information acquisition module is used for acquiring the positioning information of the storage article in a preset positioning mode;
and the early warning information acquisition module is used for generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
One or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a method of monitoring warehoused items in accordance with any of the embodiments of the invention.
In a fourth aspect, embodiments of the present invention further provide a computer readable storage medium having a computer program stored thereon, wherein the program when executed by a processor implements a method for monitoring warehoused articles according to any of the embodiments of the present invention.
According to the technical scheme, vibration information of the stored articles is monitored, and the light sensation information in the preset area containing the stored articles is included; acquiring a monitoring video of the storage article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition; acquiring positioning information of the storage articles through a preset positioning mode; and generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information. According to the technical scheme, the monitoring and early warning of the stored articles are realized, and the safety of the stored articles is improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
FIG. 1 is a flow chart of a method for monitoring stored items in an embodiment;
FIG. 2 is a schematic diagram of a system for monitoring items stored in a warehouse in one embodiment;
FIG. 3 is a flow chart of a determining an object positioning unit in one embodiment;
FIG. 4 is a schematic diagram of RFID ranging in one embodiment;
FIG. 5 is a schematic structural view of a monitoring device for stored articles in one embodiment;
fig. 6 is a schematic structural diagram of an electronic device in one embodiment.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In an embodiment of the present invention, as shown in fig. 1, a method for monitoring a storage article is disclosed, where the embodiment of the present invention is applicable to a case of monitoring a storage article, the method for monitoring a storage article of the embodiment of the present invention may be implemented by a device for monitoring a storage article, and the device may be implemented in a form of software and/or hardware.
As shown in fig. 1, the method for monitoring the warehouse articles according to the embodiment of the invention specifically includes the following steps:
s110, monitoring vibration information of the warehouse articles and light sensation information in a preset area comprising the warehouse articles.
Where warehouse items may refer to items stored in a warehouse, including but not limited to mechanical devices, food, furniture, and the like. The vibration information may be obtained by a sensor for detecting an impact force, and the vibration signal may be converted into an electrical signal, and the vibration signal corresponding to the electrical signal may be obtained through an electronic circuit. The preset area may refer to a warehouse, or may refer to a designated area in a warehouse. Alternatively, different areas may be divided according to walls. The light sensing information may mean that the light sensing sensor may be disposed within a preset area according to the acquisition of the light sensing sensor so as to acquire the light sensing information within the preset area.
Specifically, vibration information of the storage articles and light sensation information in a preset area including the storage articles are monitored in real time, so that the vibration information and the light sensation information can be obtained at any time, and preparation work is carried out for judging the vibration information and the light sensation information subsequently.
And S120, acquiring a monitoring video of the warehouse article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition.
Wherein the vibration information comprises an electrical signal describing the vibration signal. The light-sensitive information includes an optical signal or an optical radiation signal. The acquisition mode of the monitoring video can be that light rays acquired through a lens of the miniature camera are projected on the photosensitive element through the miniature camera to obtain optical signals. The light signal is converted into an electrical signal by the photosensitive element, and the electrical signal is converted into a digital signal. The digital signals are compressed and then transmitted to a memory, so that a monitoring video is obtained.
The preset vibration condition and the preset light sensation condition may be determined according to a geographical environment of the preset area, for example, the preset vibration condition includes a case where the vibration signal is within a preset vibration signal range. The preset light sensing condition includes a case where the optical signal is within a preset optical signal range or the optical radiation signal is within a preset optical radiation signal range.
Specifically, whether the vibration information meets preset vibration conditions is judged, whether the light sensation information meets the preset light sensation conditions is judged under the condition that the vibration information meets the preset vibration conditions, and the risk that the current storage article possibly moves is predicted under the condition that the light sensation information meets the preset light sensation conditions, so that a monitoring video of the storage article is obtained, and the state of the storage article is further judged.
S130, acquiring positioning information of the warehouse article through a preset positioning mode.
The preset positioning method refers to a preset positioning mode, including but not limited to satellite positioning, wireless network positioning, base station positioning, and the like. The positioning information refers to the position of the storage article, and may be coordinate information or longitude and latitude information, for example, in a preset area, two quadrants parallel to a horizontal plane are divided, so as to obtain the coordinate information of the storage article, and for example, the longitude and latitude information of the storage article is obtained.
Specifically, the positioning information of the storage articles is obtained through a preset positioning mode, so that the positioning information is obtained, and preparation work is carried out for generating early warning information of the storage articles subsequently.
And S140, generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
The early warning information refers to information related to the warehouse articles and used for reminding workers.
In the embodiment of the invention, the early warning information of the warehouse article is generated by processing the vibration information, the light sensation information, the monitoring video and the positioning information.
According to the technical scheme, the vibration information of the storage articles and the light sensation information in the preset area including the storage articles are monitored, the monitoring video of the storage articles is obtained under the condition that the vibration information meets the preset vibration condition and the light sensation information meets the preset light sensation condition, the positioning information of the storage articles is obtained through the preset positioning mode, and the early warning information of the storage articles is generated according to the vibration information, the light sensation information, the monitoring video and the positioning information.
In another embodiment of the present invention, the preset positioning manner includes a plurality of positioning sub-manners, where the positioning sub-manners include any one of a satellite positioning sub-manner, a wireless network positioning sub-manner, a base station positioning sub-manner, and a radio frequency card unit positioning sub-manner; the obtaining the positioning information of the warehouse article through a preset positioning mode comprises the following steps: determining any positioning mode as a target positioning mode from the positioning sub modes; and acquiring the positioning information of the storage article in a target positioning mode.
The satellite positioning sub-mode can refer to the positioning of the warehouse articles by a global positioning system (Global Positioning System, GPS) and a Beidou dual-mode positioning chip. The longitude and latitude information of the storage article can be obtained, and optionally, the storage article is provided with an intelligent terminal, and the longitude and latitude information of the intelligent terminal is obtained in a satellite positioning sub-mode, so that the longitude and latitude information of the storage article is obtained. Wireless network location may refer to wireless network (Wireless Fidelity, WIFI) location or base station location. And analyzing the initial positioning information obtained by the base station or the WIFI through the positioning database, so that longitude and latitude information corresponding to the initial positioning information can be obtained. The positioning sub-mode of the radio frequency card unit can refer to radio frequency identification (Radio Frequency Identification, RFID) which identifies the position of the warehouse goods through radio frequency signals. The principle of RFID positioning is that characteristic information (such as identity ID, received signal strength and the like) of a target RFID label is read through a fixed reader-writer, and the position of the target RFID label is determined, so that the target RFID label is attached to a warehouse article.
Specifically, from each positioning sub-mode, a positioning sub-mode is determined to be a target positioning mode, and positioning information of the storage article is obtained through the target positioning mode.
In another embodiment of the present invention, the determining, from each of the positioning sub-manners, any one of the positioning sub-manners as the target positioning manner includes: and determining any positioning mode as a target positioning mode according to the priority of each positioning sub-mode and whether the positioning sub-mode acquires the positioning information of the storage article.
In the embodiment of the invention, the priority of each positioning sub-mode is preset, when the positioning information is acquired, any positioning sub-mode is determined to be the target positioning mode according to the priority of each positioning sub-mode and whether the positioning sub-mode can acquire the positioning information of the storage article, the determination of the target positioning mode is realized, the order of each positioning sub-mode can be determined according to the priority of the positioning sub-mode, and then whether the positioning sub-mode can acquire the positioning information of the storage article is sequentially determined, and the determination of the final target positioning mode is realized by the judging mode, so that the effectiveness of the determination of the target positioning mode is ensured.
In another embodiment of the present invention, the priority of the positioning sub-mode is, in order from high to low: a satellite positioning sub-mode, a wireless network positioning sub-mode, a base station positioning sub-mode and a radio frequency card unit positioning sub-mode; the determining, according to the priority of each positioning sub-mode and whether the positioning sub-mode can acquire the positioning information of the warehouse article, that any positioning mode is a target positioning mode includes: judging whether positioning information of the storage article is obtained in a satellite positioning sub-mode; if the positioning information of the warehouse article is obtained, the satellite positioning sub-mode is used as a target positioning mode; if the positioning information of the storage article is not obtained, judging whether the positioning information of the storage article is obtained in a wireless network positioning sub-mode; if the positioning information of the warehouse article is obtained, the wireless network positioning sub-mode is used as a target positioning mode; if the positioning information of the storage article is not obtained, judging whether the positioning information of the storage article is obtained in a base station positioning sub-mode; if the positioning information of the warehouse article is obtained, the base station positioning sub-mode is used as a target positioning mode; and if the positioning information of the warehouse article is not obtained, taking the positioning sub-mode of the radio frequency card unit as a target positioning mode.
In the embodiment of the invention, whether the positioning information of the storage article can be obtained or not is firstly judged according to the priority, if the positioning information can be obtained by the satellite positioning sub-mode, the satellite positioning sub-mode is used as a target positioning mode, and the real-time positioning of the storage article is carried out to obtain the positioning information. If the satellite positioning sub-mode does not acquire the positioning information of the storage article, judging whether the positioning information of the storage article can be acquired by the wireless network positioning sub-mode of the next priority of the satellite positioning sub-mode, and if the wireless network positioning sub-mode can acquire the positioning information of the storage article, taking the wireless network positioning sub-mode as a target positioning mode. If the wireless network positioning sub-can not obtain the positioning information of the storage article, judging whether the base station positioning sub-mode of the next priority of the wireless network positioning sub-mode can obtain the positioning information of the storage article. If the base station positioning sub-mode can acquire the positioning information, the base station positioning sub-mode is used as a target positioning mode to perform real-time positioning of the storage article, and the positioning information is acquired. If the base station positioning sub-mode does not acquire the positioning information of the storage article, the radio frequency card unit positioning sub-mode is used as a target positioning mode to acquire the positioning information of the storage article. The technical scheme of the embodiment of the invention realizes the judgment of whether the positioning sub-modes can acquire the positioning information according to the priority, further determines the target positioning mode, ensures that the target positioning mode can acquire the positioning information of the storage article, and can determine different positioning sub-modes as the target positioning mode due to the reasons of the geographical environment, the network environment and the like of the warehouse where the storage article is positioned, thereby realizing the acquisition of the positioning information of the storage article no matter what environment is in.
In another embodiment of the present invention, the early warning information includes first early warning information and second early warning information; the generating the early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information comprises the following steps: if the storage article is determined not to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information, generating first early warning information of the storage article, wherein the first early warning information comprises information that the storage article is not in the preset area, and the vibration information, the light sensation information and the monitoring video of the storage article; and if the storage article is determined to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information, generating second early warning information of the storage article, wherein the second early warning information comprises information that the storage article is in the preset area and the monitoring video of the storage article.
The message that the warehouse article is not in the preset area may be: the warehouse item a is not in the preset area C. The message of the warehouse article in the preset area may be: the warehouse article a is in the preset area C.
Specifically, whether the storage article is in the preset area or not is judged through the vibration information, the light sensation information, the monitoring video and the positioning information, if the storage article is in the preset area, second early warning information is generated, if the storage article is not in the preset area, first early warning information is generated, the two early warning information can ensure that the early warning information is generated under the condition that the vibration information meets the preset vibration condition and the light sensation information meets the preset light sensation condition, and the two early warning information can be referred by a worker, so that the current storage article condition is known, the experience degree of the worker is improved, and the work of the worker is assisted.
Optionally, the first early warning information may be generated by judging whether the vibration information satisfies a preset vibration early warning condition, whether the light sensation information satisfies a preset light sensation early warning condition, whether a key frame image in the monitoring video satisfies a preset image condition and whether the positioning information satisfies a preset positioning condition, if three of the four judgments satisfy the conditions, for example, the vibration information satisfies the preset vibration early warning condition, the key frame image in the monitoring video satisfies the preset image condition and the positioning information satisfies the preset positioning condition, the first early warning information is generated, and of course, how many specific judgments satisfy the conditions may be set according to actual conditions, which is not limited specifically herein.
The preset vibration early warning condition in the embodiment of the invention may include vibration information, that is, the vibration signal is higher than the preset vibration signal threshold. The preset light sensation early warning condition may include that an electrical signal corresponding to the light sensation signal is lower than a preset electrical signal threshold value within a continuous first preset time period. The preset image condition may mean that a difference value of a continuous preset number of key frame images in the key frame images of the monitoring video is greater than a first preset difference threshold. The preset positioning condition may mean that a difference value of positioning information in a continuous second preset time period is greater than a second preset difference threshold.
In another embodiment of the present invention, after the determining that the warehouse article is not in the preset area according to the vibration information, the light sensation information, the monitoring video, and the positioning information, the method further includes: and storing vibration information, light sensation information and monitoring video of the warehouse articles in the first early warning information.
In the embodiment of the invention, after the storage article is determined not to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information and the first early warning information of the storage article is generated, the vibration information, the light sensation information and the monitoring video of the storage article in the first early warning information are stored, so that the personnel can trace back conveniently.
In another embodiment of the present invention, in a case where the vibration information satisfies a preset vibration condition or the light sensation information does not satisfy a preset light sensation condition, the method further includes: periodically acquiring the positioning information of the warehouse articles through the preset positioning mode; and generating record information by using the vibration information, the light sensation information and the positioning information.
The preset positioning manner is the same as that in the above embodiment, and related technical terms will not be repeated.
In the embodiment of the invention, the positioning information of the warehouse articles is periodically acquired through a preset positioning mode, and the vibration information, the light sensation information and the positioning information in the same period are generated into the record information so that the staff can conveniently review. Optionally, record information is stored in sequence, and when consulting, the record information can be consulted according to the specific time period of each period, so that the record information is convenient for staff to consult.
In another embodiment of the present invention, a system for monitoring a warehouse article is provided, where the system for monitoring a warehouse article according to the embodiment of the present invention may implement the method for monitoring a warehouse article in any of the foregoing embodiments, and has a functional module and beneficial effects corresponding to the execution method. As shown in fig. 2, the system includes: intelligent terminal 1, thing networking platform 2 and early warning system 3, wherein:
The intelligent terminal is installed on the storage article, can place on the outer package of storage article, and intelligent terminal uses the continuation of journey battery power supply, gathers positioning information, vibration information, light sense information and surveillance video to with positioning information, vibration information, light sense information and the surveillance video who gathers through storage and calculation processing, through communication module, transmit in the internet of things platform. The communication module comprises a fifth generation mobile communication technology (5th Generation Mobile Communication Technology,5G) communication module, and the data transmission speed is higher.
Optionally, the intelligent terminal comprises a positioning module, a video monitoring module, a battery, a storage module, an information processing module, a communication module, a light sensor, a vibration sensor and the like.
The positioning module comprises a GPS/Beidou satellite positioning unit, a WiFi positioning unit, a base station positioning unit and an RFID positioning unit, any positioning unit is selected as a target positioning unit, the acquisition of positioning information of the storage articles is carried out, and the acquisition of the positioning information of the monitoring storage articles, namely the positioning information, can be ensured.
The video monitoring module is used for acquiring a monitoring video, and the storage module is used for storing positioning information, the monitoring video, light sensation information and vibration information. The information processing module is used for preprocessing vibration information, light sense information, monitoring video and positioning information to obtain information which can be transmitted to the platform of the Internet of things.
The internet of things platform is used for displaying positioning information, processing the positioning information and the vibration information so that the vibration information meets preset vibration conditions and the light sensation information meets preset light sensation conditions, generating early warning information of the storage articles based on the vibration information, the light sensation information, the monitoring video and the positioning information, and sending the early warning information to the early warning system so as to early warn the storage articles.
As shown in fig. 3, when any positioning unit is selected as the target positioning unit to acquire positioning information of the warehouse article, the determination may be performed according to the following manner: the intelligent terminal searches satellite signals of the GPS/Beidou satellite positioning unit and positioning information of the storage articles, if the intelligent terminal determines that the number of the GPS/Beidou satellites is greater than or equal to 3 according to the satellite signals and acquires the positioning information, the GPS/Beidou satellite positioning unit is used as a target positioning unit to acquire the positioning information of the storage articles and sends the positioning information to the platform of the Internet of things. If the intelligent terminal does not receive satellite signals, or the number of GPS/Beidou satellites is determined to be less than 3 according to the satellite signals, or positioning information cannot be acquired, the intelligent terminal searches WIFI signals of the WIFI positioning unit and positioning information of storage objects transmitted according to the WIFI positioning unit, if the intelligent terminal judges that the number of MAC addresses of the acquired WIFI positioning unit is greater than or equal to 3 according to the WIFI signals, and acquires the positioning information, the intelligent terminal takes the WIFI positioning unit as a target positioning unit, acquires the positioning information of the storage objects, and uploads the positioning information to an Internet of things platform. If the intelligent terminal judges that the number of the acquired MAC addresses of the WIFI positioning units is smaller than 3 or the positioning information cannot be acquired, the intelligent terminal searches the base station signals and the positioning information of the storage articles transmitted by the base station, if the intelligent terminal judges that the number of the received base station positioning units is larger than or equal to 3 according to the base station signals and the positioning information can be acquired, the base station positioning units are used as target positioning units, if the number of the base station positioning units is smaller than 3 or the positioning information cannot be acquired, the intelligent terminal takes the RFID positioning units as target positioning units, namely the RFID positioning units are started to transmit RFID signals to the RFID reader, and the RFID reader transmits the positioning information of the storage articles to the platform of the Internet of things. The internet of things platform adopts a positioning method based on distance measurement, and positions the RFID tag through a reader-writer at a known position to obtain position information, wherein the RFID tag is arranged on the storage article, and the reader-writer can be arranged at other positions except the storage article.
Exemplary methods of ranging include Time of Arrival (TOA) ranging principles.
The distance measurement-based method is to calculate the actual distance between the RFID reader and each RFID tag through a distance measurement technology, and calculate the positions of the RFID tag and the RFID reader through a geometric mode. The TOA distance measurement method is used for measuring the direct arrival time of a received signal between the RFID reader-writer and the movable RFID tag and converting the arrival time into the distance so as to position, and the method can calculate the position of the storage article by only 3 RFID reader-writers.
As shown in fig. 4, distances between three RFID reader-writer positions (D1, D2, D3) and an RFID tag position (B) are respectively r1, r2, r3, and 3 circles are drawn by taking the RFID reader-writer positions as circle centers and distances from the RFID tag positions as radii, wherein an intersection point B is the position where the RFID tag is located; when the three RFID reader locations are all locations of line-of-sight transmission of wireless signals, the estimated location of RFID tag B may generally be calculated according to a least squares algorithm.
It should be appreciated that the wireless router has 1 media access control address (Media Access Control Address, MAC address).
The RFID positioning module is used for acquiring positioning information and transmitting the positioning information to the Internet of things platform through the RFID reader-writer and the wired network.
The internet of things platform analyzes and cleans the data of the positioning information, the light sensation information and the monitoring video, and the data of the positioning information, the light sensation information and the monitoring video
In another embodiment of the present invention, the monitoring system for warehouse articles further includes: and the communication module is used for transmitting the positioning information, the light sensation information, the vibration information and the video information acquired by the intelligent terminal to the Internet of things platform.
In another embodiment of the present invention, the monitoring system for warehouse articles further includes: the mobile terminal is in communication connection with the early warning system and is used for receiving the early warning information of the early warning system so as to be displayed to a user at the mobile terminal side.
In another embodiment of the present invention, the pre-warning system sets an electronic fence with a predetermined position as a center, and the electronic fence may be set according to actual situations, for example, 5km wide, 10km long, and the like. The storage articles can be vehicles, engineering machinery and the like. The storage articles are arranged in the electronic fence, the early warning system judges whether the storage articles are in the electronic fence or not according to the positioning information and the monitoring video in the received early warning information, if the storage articles are not in the electronic fence, an alarm message is generated, and the alarm message indicates that the storage articles are not in the electronic fence. The electronic fence in the embodiment of the invention can be arranged in the preset area, and of course, can also be arranged outside the preset area, so that the monitoring of the stored articles can be more accurate, and the safety of the stored articles is stronger.
In another embodiment of the present invention, a device for monitoring a storage article is provided, and fig. 5 is a schematic structural diagram of the device for monitoring a storage article provided in the embodiment of the present invention, where the device for monitoring a storage article provided in the embodiment of the present invention may execute the method for monitoring a storage article provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device comprises: an information acquisition module 410, a surveillance video acquisition module 420, a positioning information acquisition module 430, and an early warning information acquisition module 440, wherein:
the information acquisition module 410 is configured to monitor vibration information of the warehouse article and light sensation information in a preset area including the warehouse article; the monitoring video obtaining module 420 is configured to obtain a monitoring video of the warehouse article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition; the positioning information obtaining module 430 is configured to obtain positioning information of the warehouse article through a preset positioning manner; the early warning information acquisition module 440 is configured to generate early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
In another embodiment of the present invention, the preset positioning manner includes a plurality of positioning sub-manners, where the positioning sub-manners include any one of a satellite positioning sub-manner, a wireless network positioning sub-manner, a base station positioning sub-manner, and a radio frequency card unit positioning sub-manner;
the positioning information acquisition module 430 is further configured to:
determining any positioning mode as a target positioning mode from the positioning sub modes;
and acquiring the positioning information of the storage article in a target positioning mode.
In another embodiment of the present invention, the positioning information obtaining module 430 is further configured to:
and determining any positioning mode as a target positioning mode according to the priority of each positioning sub-mode and whether the positioning sub-mode acquires the positioning information of the storage article.
In another embodiment of the present invention, the priority of the positioning sub-mode is, in order from high to low: a satellite positioning sub-mode, a wireless network positioning sub-mode, a base station positioning sub-mode and a radio frequency card unit positioning sub-mode;
the positioning information acquisition module 430 is further configured to:
judging whether positioning information of the storage article is obtained in a satellite positioning sub-mode;
if the positioning information of the warehouse article is obtained, the satellite positioning sub-mode is used as a target positioning mode;
If the positioning information of the storage article is not obtained, judging whether the positioning information of the storage article is obtained in a wireless network positioning sub-mode;
if the positioning information of the warehouse article is obtained, the wireless network positioning sub-mode is used as a target positioning mode;
if the positioning information of the storage article is not obtained, judging whether the positioning information of the storage article is obtained in a base station positioning sub-mode;
if the positioning information of the warehouse article is obtained, the base station positioning sub-mode is used as a target positioning mode;
and if the positioning information of the warehouse article is not obtained, taking the positioning sub-mode of the radio frequency card unit as a target positioning mode.
In another embodiment of the present invention, the early warning information includes first early warning information and second early warning information;
the early warning information acquisition module 440 is further configured to:
if the storage article is determined not to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information, generating first early warning information of the storage article, wherein the first early warning information comprises information that the storage article is not in the preset area, and the vibration information, the light sensation information and the monitoring video of the storage article;
And if the storage article is determined to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information, generating second early warning information of the storage article, wherein the second early warning information comprises information that the storage article is in the preset area and the monitoring video of the storage article.
In another embodiment of the present invention, the apparatus further includes:
and the information storage module is used for storing vibration information, light sensation information and monitoring video of the storage articles in the first early warning information.
In another embodiment of the present invention, the apparatus further includes:
the information recording module is used for periodically acquiring the positioning information of the storage articles in the preset positioning mode; and generating record information by using the vibration information, the light sensation information and the positioning information.
According to the technical scheme, vibration information of the stored articles is monitored, and the light sensation information in the preset area containing the stored articles is included; acquiring a monitoring video of the storage article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition; acquiring positioning information of the storage articles through a preset positioning mode; and generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information. According to the technical scheme, the monitoring and early warning of the stored articles are realized, and the safety of the stored articles is improved.
It should be noted that each module included in the above apparatus is only divided according to the functional logic, but not limited to the above division, so long as the corresponding function can be implemented; in addition, the specific names of the functional modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiments of the present invention.
In another embodiment of the invention, an electronic device is provided. Fig. 6 shows a block diagram of an exemplary electronic device 50 suitable for use in implementing the embodiments of the present invention. The electronic device 50 shown in fig. 6 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 6, the electronic device 50 is in the form of a general purpose computing device. Components of electronic device 50 may include, but are not limited to: one or more processors or processing units 501, a system memory 502, and a bus 503 that connects the various system components (including the system memory 502 and processing units 501).
Bus 503 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 50 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by electronic device 50 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 502 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 504 and/or cache memory 505. Electronic device 50 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 506 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard disk drive"). Although not shown in fig. 6, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 503 through one or more data medium interfaces. Memory 502 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 508 having a set (at least one) of program modules 507 may be stored, for example, in memory 502, such program modules 507 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 507 typically perform the functions and/or methods of the described embodiments of the invention.
The electronic device 50 may also communicate with one or more external devices 509 (e.g., keyboard, pointing device, display 510, etc.), one or more devices that enable a user to interact with the electronic device 50, and/or any device (e.g., network card, modem, etc.) that enables the electronic device 50 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 511. Also, the electronic device 50 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through a network adapter 512. As shown, the network adapter 512 communicates with other modules of the electronic device 50 over the bus 503. It should be appreciated that although not shown in fig. 6, other hardware and/or software modules may be used in connection with electronic device 50, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 501 executes programs stored in the system memory 502 to perform various functional applications and data processing, for example, to implement the method for monitoring warehouse items according to the embodiment of the present invention.
In another embodiment of the present invention, there is also provided a storage medium containing computer-executable instructions, which when executed by a computer processor, are for performing a method of monitoring items in a warehouse, the method comprising:
monitoring vibration information of the stored articles and light sensation information in a preset area comprising the stored articles;
acquiring a monitoring video of the warehouse article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition;
acquiring positioning information of the storage articles in a preset positioning mode;
and generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.
Claims (10)
1. A method of monitoring warehoused items, the method comprising:
monitoring vibration information of the stored articles and light sensation information in a preset area comprising the stored articles;
acquiring a monitoring video of the warehouse article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition;
Acquiring positioning information of the storage articles in a preset positioning mode;
and generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
2. The method of claim 1, wherein the predetermined positioning means comprises a plurality of positioning sub-means, the positioning sub-means comprising any one of a satellite positioning sub-means, a wireless network positioning sub-means, a base station positioning sub-means, and a radio frequency card unit positioning sub-means;
the obtaining the positioning information of the warehouse article through a preset positioning mode comprises the following steps:
determining any positioning mode as a target positioning mode from the positioning sub modes;
and acquiring the positioning information of the storage article in a target positioning mode.
3. The method of claim 2, wherein determining any one of the positioning sub-modes as a target positioning mode comprises:
and determining any positioning mode as a target positioning mode according to the priority of each positioning sub-mode and whether the positioning sub-mode acquires the positioning information of the storage article.
4. A method of monitoring warehoused articles according to claim 3, wherein the priority of the positioning means is, in order from high to low: a satellite positioning sub-mode, a wireless network positioning sub-mode, a base station positioning sub-mode and a radio frequency card unit positioning sub-mode;
the determining, according to the priority of each positioning sub-mode and whether the positioning sub-mode obtains the positioning information of the warehouse article, that any positioning mode is a target positioning mode includes:
judging whether positioning information of the storage article is obtained in a satellite positioning sub-mode;
if the positioning information of the warehouse article is obtained, the satellite positioning sub-mode is used as a target positioning mode;
if the positioning information of the storage article is not obtained, judging whether the positioning information of the storage article is obtained in a wireless network positioning sub-mode;
if the positioning information of the warehouse article is obtained, the wireless network positioning sub-mode is used as a target positioning mode;
if the positioning information of the storage article is not obtained, judging whether the positioning information of the storage article is obtained in a base station positioning sub-mode;
if the positioning information of the warehouse article is obtained, the base station positioning sub-mode is used as a target positioning mode;
And if the positioning information of the warehouse article is not obtained, taking the positioning sub-mode of the radio frequency card unit as a target positioning mode.
5. The method of claim 1, wherein the pre-warning information comprises first pre-warning information and second pre-warning information;
the generating the early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information comprises the following steps:
if the storage article is determined not to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information, generating first early warning information of the storage article, wherein the first early warning information comprises information that the storage article is not in the preset area, and the vibration information, the light sensation information and the monitoring video of the storage article;
and if the storage article is determined to be in the preset area according to the vibration information, the light sensation information, the monitoring video and the positioning information, generating second early warning information of the storage article, wherein the second early warning information comprises information that the storage article is in the preset area and the monitoring video of the storage article.
6. The method according to claim 5, wherein after the step of generating the first warning information of the warehouse article if the warehouse article is determined not to be in the preset area according to the vibration information, the light sensation information, the monitoring video, and the positioning information, the method further comprises:
and storing vibration information, light sensation information and monitoring video of the warehouse articles in the first early warning information.
7. The method of claim 1, wherein in the event that the vibration information satisfies a preset vibration condition or the light sensation information does not satisfy a preset light sensation condition, the method further comprises:
periodically acquiring the positioning information of the warehouse articles through the preset positioning mode;
and generating record information by using the vibration information, the light sensation information and the positioning information.
8. A device for monitoring items in a warehouse, the device comprising:
the information acquisition module is used for monitoring vibration information of the storage articles and comprises light sensation information in a preset area of the storage articles;
the monitoring video acquisition module is used for acquiring the monitoring video of the storage article when the vibration information meets a preset vibration condition and the light sensation information meets a preset light sensation condition;
The positioning information acquisition module is used for acquiring the positioning information of the storage article in a preset positioning mode;
and the early warning information acquisition module is used for generating early warning information of the warehouse article based on the vibration information, the light sensation information, the monitoring video and the positioning information.
9. An electronic device, the electronic device comprising:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method of monitoring warehoused items of any of claims 1-7.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements a method of monitoring items in storage according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310816012.0A CN117061700A (en) | 2023-07-04 | 2023-07-04 | Warehouse article monitoring method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310816012.0A CN117061700A (en) | 2023-07-04 | 2023-07-04 | Warehouse article monitoring method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117061700A true CN117061700A (en) | 2023-11-14 |
Family
ID=88657879
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310816012.0A Pending CN117061700A (en) | 2023-07-04 | 2023-07-04 | Warehouse article monitoring method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117061700A (en) |
-
2023
- 2023-07-04 CN CN202310816012.0A patent/CN117061700A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Hayward et al. | A survey of indoor location technologies, techniques and applications in industry | |
| US9191992B2 (en) | System and method for participants data retrieval post accident or event | |
| US11881094B2 (en) | Infrastructure construction digital integrated twin (ICDIT) | |
| US9068836B2 (en) | Real-time location information system using multiple positioning technologies | |
| US20180032829A1 (en) | System for collecting event data, method for collecting event data, service server for collecting event data, and camera | |
| CN112950773A (en) | Data processing method and device based on building information model and processing server | |
| EP3635430B1 (en) | Method and apparatus for determining the location of a static object | |
| CN111624550B (en) | Vehicle positioning method, device, equipment and storage medium | |
| US20210319699A1 (en) | Parking control system, parking control method, and mobile robot device | |
| CN110186472B (en) | Vehicle yaw detection method, computer device, storage medium, and vehicle system | |
| Dörterler et al. | Neural network based vehicular location prediction model for cooperative active safety systems | |
| CN117061700A (en) | Warehouse article monitoring method and device, electronic equipment and storage medium | |
| EP4099292A2 (en) | Method and apparatus of determining state of target object, electronic device, storage medium, and program product | |
| Hidayat et al. | Mapping of MAC Address with Moving WiFi Scanner | |
| Pradeepkumar et al. | Real Time Automatic Vehicle Monitoring System Using IoT | |
| CN212321837U (en) | Low-altitude infrared target accurate positioning system | |
| CN115097379A (en) | Positioning tracking method, device, equipment and storage medium | |
| CN115183785A (en) | Vehicle state detection method, device, terminal, program product and vehicle | |
| Wang et al. | [Retracted] Personnel Positioning System Method in Building Based on Inertial Sensor | |
| US12055717B2 (en) | Inspection system and inspection method | |
| CN116704804B (en) | Guide vehicle path guiding and early warning method and system under airport low visibility condition | |
| US20230224675A1 (en) | Connected system for tracking of tagged objects | |
| Miah et al. | Advance waterway transport system based on Internet of Things (IoT) | |
| Hatipoglu et al. | Overhead object projector: OverProjNet | |
| CN111653124A (en) | Data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |